Nov 24 18:48:00 user nova-compute[75051]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75051) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 18:48:00 user nova-compute[75051]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75051) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 18:48:00 user nova-compute[75051]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75051) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 24 18:48:00 user nova-compute[75051]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 24 18:48:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:48:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:48:01 user nova-compute[75051]: INFO nova.virt.driver [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 24 18:48:01 user nova-compute[75051]: INFO nova.compute.provider_config [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Acquiring lock "singleton_lock" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Acquired lock "singleton_lock" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Releasing lock "singleton_lock" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Full set of CONF: {{(pid=75051) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ******************************************************************************** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Configuration options gathered from: {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ================================================================================ {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] allow_resize_to_same_host      = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] arq_binding_timeout            = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] backdoor_port                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] backdoor_socket                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] block_device_allocate_retries  = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] block_device_allocate_retries_interval = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cert                           = self.pem {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute_monitors               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] config_dir                     = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] config_drive_format            = iso9660 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] config_source                  = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] console_host                   = user {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] control_exchange               = nova {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cpu_allocation_ratio           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] daemon                         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] debug                          = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_access_ip_network_name = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_availability_zone      = nova {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_ephemeral_format       = ext4 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_green_pool_size        = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] default_schedule_zone          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] disk_allocation_ratio          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] enable_new_services            = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] enabled_ssl_apis               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] flat_injected                  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] force_config_drive             = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] force_raw_images               = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] graceful_shutdown_timeout      = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] heal_instance_info_cache_interval = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] host                           = user {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_build_timeout         = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_delete_interval       = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_name_template         = instance-%08x {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_usage_audit           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_usage_audit_period    = month {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] internal_service_availability_zone = internal {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] key                            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] live_migration_retry_count     = 30 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_config_append              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_dir                        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_file                       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_options                    = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_rotate_interval            = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_rotate_interval_type       = days {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] log_rotation_type              = none {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] long_rpc_timeout               = 1800 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_concurrent_builds          = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_concurrent_live_migrations = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_concurrent_snapshots       = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_local_block_devices        = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_logfile_count              = 30 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] max_logfile_size_mb            = 200 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] maximum_instance_delete_attempts = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metadata_listen                = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metadata_listen_port           = 8775 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metadata_workers               = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] migrate_max_retries            = -1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] mkisofs_cmd                    = genisoimage {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] my_ip                          = 10.0.0.210 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] network_allocate_retries       = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] osapi_compute_listen_port      = 8774 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] osapi_compute_unique_server_name_scope =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] osapi_compute_workers          = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] password_length                = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] periodic_enable                = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] periodic_fuzzy_delay           = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] pointer_model                  = ps2mouse {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] preallocate_images             = none {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] publish_errors                 = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] pybasedir                      = /opt/stack/nova {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ram_allocation_ratio           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rate_limit_burst               = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rate_limit_except_level        = CRITICAL {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rate_limit_interval            = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reboot_timeout                 = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reclaim_instance_interval      = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] record                         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reimage_timeout_per_gb         = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] report_interval                = 120 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rescue_timeout                 = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reserved_host_cpus             = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reserved_host_disk_mb          = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reserved_host_memory_mb        = 512 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] reserved_huge_pages            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] resize_confirm_window          = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] resize_fs_using_block_device   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] resume_guests_state_on_host_boot = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rpc_response_timeout           = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] run_external_periodic_tasks    = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] running_deleted_instance_action = reap {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] running_deleted_instance_timeout = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler_instance_sync_interval = 120 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_down_time              = 720 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] servicegroup_driver            = db {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] shelved_offload_time           = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] shelved_poll_interval          = 3600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] shutdown_timeout               = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] source_is_ipv6                 = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ssl_only                       = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] state_path                     = /opt/stack/data/nova {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] sync_power_state_interval      = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] sync_power_state_pool_size     = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] syslog_log_facility            = LOG_USER {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] tempdir                        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] timeout_nbd                    = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] transport_url                  = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] update_resources_interval      = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_cow_images                 = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_eventlog                   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_journal                    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_json                       = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_rootwrap_daemon            = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_stderr                     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] use_syslog                     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vcpu_pin_set                   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plugging_is_fatal          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plugging_timeout           = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] virt_mkfs                      = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] volume_usage_poll_interval     = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] watch_log_file                 = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] web                            = /usr/share/spice-html5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_concurrency.disable_process_locking = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.auth_strategy              = keystone {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.compute_link_prefix        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.dhcp_domain                = novalocal {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.enable_instance_password   = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.glance_link_prefix         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.instance_list_per_project_cells = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.list_records_by_skipping_down_cells = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.local_metadata_per_cell    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.max_limit                  = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.metadata_cache_expiration  = 15 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.neutron_default_tenant_id  = default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.use_forwarded_for          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.use_neutron_default_nets   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_dynamic_targets = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_jsonfile_path   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.backend_argument         = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.config_prefix            = cache.oslo {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.dead_timeout             = 60.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.debug_cache_backend      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.enable_retry_client      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.enable_socket_keepalive  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.enabled                  = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.expiration_time          = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.hashclient_retry_attempts = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_dead_retry      = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_password        =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_sasl_enabled    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.memcache_username        =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.proxies                  = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.retry_attempts           = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.retry_delay              = 0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.socket_keepalive_count   = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.socket_keepalive_idle    = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.socket_keepalive_interval = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.tls_allowed_ciphers      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.tls_cafile               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.tls_certfile             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.tls_enabled              = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cache.tls_keyfile              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.auth_section            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.auth_type               = password {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.cafile                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.certfile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.collect_timing          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.cross_az_attach         = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.debug                   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.endpoint_template       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.http_retries            = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.insecure                = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.keyfile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.os_region_name          = RegionOne {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.split_loggers           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cinder.timeout                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.cpu_dedicated_set      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.cpu_shared_set         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.image_type_exclude_list = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.resource_provider_association_refresh = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.shutdown_retry_interval = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] conductor.workers              = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] console.allowed_origins        = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] console.ssl_ciphers            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] console.ssl_minimum_version    = default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] consoleauth.token_ttl          = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.cafile                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.certfile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.collect_timing          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.connect_retries         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.connect_retry_delay     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.endpoint_override       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.insecure                = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.keyfile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.max_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.min_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.region_name             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.service_name            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.service_type            = accelerator {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.split_loggers           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.status_code_retries     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.timeout                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] cyborg.version                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.backend               = sqlalchemy {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.connection            = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.connection_debug      = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.connection_parameters =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.connection_recycle_time = 3600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.connection_trace      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.db_inc_retry_interval = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.db_max_retries        = 20 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.db_max_retry_interval = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.db_retry_interval     = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.max_overflow          = 50 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.max_pool_size         = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.max_retries           = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.mysql_wsrep_sync_wait = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.pool_timeout          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.retry_interval        = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.slave_connection      = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] database.sqlite_synchronous    = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.backend           = sqlalchemy {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.connection        = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.connection_debug  = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.connection_parameters =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.connection_recycle_time = 3600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.connection_trace  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.db_inc_retry_interval = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.db_max_retries    = 20 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.db_max_retry_interval = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.db_retry_interval = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.max_overflow      = 50 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.max_pool_size     = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.max_retries       = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.pool_timeout      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.retry_interval    = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.slave_connection  = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] api_database.sqlite_synchronous = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] devices.enabled_mdev_types     = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ephemeral_storage_encryption.enabled = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.api_servers             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.cafile                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.certfile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.collect_timing          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.connect_retries         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.connect_retry_delay     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.debug                   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.default_trusted_certificate_ids = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.enable_certificate_validation = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.enable_rbd_download     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.endpoint_override       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.insecure                = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.keyfile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.max_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.min_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.num_retries             = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.rbd_ceph_conf           =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.rbd_connect_timeout     = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.rbd_pool                =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.rbd_user                =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.region_name             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.service_name            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.service_type            = image {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.split_loggers           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.status_code_retries     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.timeout                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.verify_glance_signatures = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] glance.version                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] guestfs.debug                  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.config_drive_cdrom      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.config_drive_inject_password = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.enable_remotefx         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.instances_path_share    =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.limit_cpu_features      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.use_multipath_io        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.vswitch_name            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] mks.enabled                    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.manager_interval   = 2400 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.precache_concurrency = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.remove_unused_base_images = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] image_cache.subdirectory_name  = _base {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.api_max_retries         = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.api_retry_interval      = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.auth_section            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.auth_type               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.cafile                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.certfile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.collect_timing          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.conductor_group         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.connect_retries         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.connect_retry_delay     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.endpoint_override       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.insecure                = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.keyfile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.max_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.min_version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.peer_list               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.region_name             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.serial_console_state_timeout = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.service_name            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.service_type            = baremetal {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.split_loggers           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.status_code_retries     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.timeout                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ironic.version                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] key_manager.fixed_key          = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.barbican_api_version  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.barbican_endpoint     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.barbican_endpoint_type = public {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.barbican_region_name  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.cafile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.certfile              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.collect_timing        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.insecure              = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.keyfile               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.number_of_retries     = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.retry_delay           = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.send_service_user_token = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.split_loggers         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.timeout               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.verify_ssl            = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican.verify_ssl_path       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.auth_section = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.auth_type = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.cafile   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.certfile = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.collect_timing = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.insecure = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.keyfile  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.split_loggers = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] barbican_service_user.timeout  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.approle_role_id          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.approle_secret_id        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.cafile                   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.certfile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.collect_timing           = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.insecure                 = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.keyfile                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.kv_mountpoint            = secret {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.kv_path                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.kv_version               = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.namespace                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.root_token_id            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.split_loggers            = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.ssl_ca_crt_file          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.timeout                  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.use_ssl                  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.auth_section          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.auth_type             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.cafile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.certfile              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.collect_timing        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.connect_retries       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.connect_retry_delay   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.endpoint_override     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.insecure              = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.keyfile               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.max_version           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.min_version           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.region_name           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.service_name          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.service_type          = identity {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.split_loggers         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.status_code_retries   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.timeout               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] keystone.version               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.connection_uri         =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_mode               = custom {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: WARNING oslo_config.cfg [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_power_governor_high = performance {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_power_management   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.device_detach_attempts = 8 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.device_detach_timeout  = 20 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.disk_cachemodes        = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.disk_prefix            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.enabled_perf_events    = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.file_backed_memory     = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.gid_maps               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.hw_disk_discard        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.hw_machine_type        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_rbd_pool        = rbd {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_type            = default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.images_volume_group    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.inject_key             = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.inject_partition       = -2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.inject_password        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.iscsi_iface            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.iser_use_multipath     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_downtime = 500 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_inbound_addr = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_scheme  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_timeout_action = abort {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_tunnelled = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: WARNING oslo_config.cfg [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 24 18:48:01 user nova-compute[75051]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 24 18:48:01 user nova-compute[75051]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 24 18:48:01 user nova-compute[75051]: and ``live_migration_inbound_addr`` respectively.
Nov 24 18:48:01 user nova-compute[75051]: ).  Its value may be silently ignored in the future.
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.live_migration_with_native_tls = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.max_queues             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.nfs_mount_options      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_pcie_ports         = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.pmem_namespaces        = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.quobyte_client_cfg     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rbd_secret_uuid        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rbd_user               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rescue_image_id        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rescue_kernel_id       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.rx_queue_size          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.smbfs_mount_options    =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.snapshot_compression   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.snapshot_image_format  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.sparse_logical_volumes = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.swtpm_enabled          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.swtpm_group            = tss {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.swtpm_user             = tss {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.sysinfo_serial         = unique {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.tb_cache_size          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.tx_queue_size          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.uid_maps               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.use_virtio_for_bridges = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.virt_type              = kvm {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.volume_clear           = zero {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.volume_clear_size      = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.volume_use_multipath   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_cache_path   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.auth_section           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.auth_type              = password {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.cafile                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.certfile               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.collect_timing         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.connect_retries        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.connect_retry_delay    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.default_floating_pool  = public {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.endpoint_override      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.extension_sync_interval = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.http_retries           = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.insecure               = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.keyfile                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.max_version            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.min_version            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.ovs_bridge             = br-int {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.physnets               = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.region_name            = RegionOne {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.service_metadata_proxy = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.service_name           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.service_type           = network {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.split_loggers          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.status_code_retries    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.timeout                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] neutron.version                = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] notifications.bdms_in_notifications = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] notifications.default_level    = INFO {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] notifications.notification_format = unversioned {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] notifications.notify_on_state_change = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] pci.alias                      = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] pci.device_spec                = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] pci.report_in_placement        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.auth_section         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.auth_type            = password {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.cafile               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.certfile             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.collect_timing       = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.connect_retries      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.connect_retry_delay  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.default_domain_id    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.default_domain_name  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.domain_id            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.domain_name          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.endpoint_override    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.insecure             = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.keyfile              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.max_version          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.min_version          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.password             = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.project_domain_id    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.project_domain_name  = Default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.project_id           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.project_name         = service {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.region_name          = RegionOne {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.service_name         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.service_type         = placement {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.split_loggers        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.status_code_retries  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.system_scope         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.timeout              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.trust_id             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.user_domain_id       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.user_domain_name     = Default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.user_id              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.username             = placement {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] placement.version              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.cores                    = 20 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.count_usage_from_placement = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.injected_file_content_bytes = 10240 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.injected_file_path_length = 255 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.injected_files           = 5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.instances                = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.key_pairs                = 100 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.metadata_items           = 128 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.ram                      = 51200 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.recheck_quota            = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.server_group_members     = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] quota.server_groups            = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rdp.enabled                    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.image_metadata_prefilter = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.max_attempts         = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.max_placement_results = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] scheduler.workers              = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.host_subset_size = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.isolated_hosts = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.isolated_images = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.pci_in_placement = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.track_instance_changes = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metrics.required               = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metrics.weight_multiplier      = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] metrics.weight_setting         = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.enabled         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.port_range      = 10000:20000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] serial_console.serialproxy_port = 6083 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.auth_section      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.auth_type         = password {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.cafile            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.certfile          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.collect_timing    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.insecure          = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.keyfile           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.send_service_user_token = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.split_loggers     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] service_user.timeout           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.agent_enabled            = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.enabled                  = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.html5proxy_port          = 6082 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.image_compression        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.jpeg_compression         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.playback_compression     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.server_listen            = 127.0.0.1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.streaming_mode           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] spice.zlib_compression         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] upgrade_levels.baseapi         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] upgrade_levels.compute         = auto {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] upgrade_levels.conductor       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] upgrade_levels.scheduler       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.cafile = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.certfile = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.insecure = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vendordata_dynamic_auth.timeout = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.api_retry_count         = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.ca_file                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.cache_prefix            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.cluster_name            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.connection_pool_size    = 10 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.console_delay_seconds   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.datastore_regex         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.host_ip                 = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.host_password           = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.host_port               = 443 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.host_username           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.insecure                = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.integration_bridge      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.maximum_objects         = 100 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.pbm_default_policy      = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.pbm_enabled             = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.pbm_wsdl_location       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.serial_port_proxy_uri   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.serial_port_service_uri = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.task_poll_interval      = 0.5 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.use_linked_clone        = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.vnc_keymap              = en-us {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.vnc_port                = 5900 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vmware.vnc_port_total          = 10000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.auth_schemes               = ['none'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.enabled                    = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.novncproxy_port            = 6080 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.vencrypt_ca_certs          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.vencrypt_client_cert       = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vnc.vencrypt_client_key        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.disable_rootwrap   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.enable_numa_live_migration = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.libvirt_disable_apic = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.client_socket_timeout     = 900 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.default_pool_size         = 1000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.keep_alive                = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.max_header_line           = 16384 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.ssl_ca_file               = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.ssl_cert_file             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.ssl_key_file              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.tcp_keepidle              = 600 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] zvm.ca_file                    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] zvm.cloud_connector_url        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] zvm.reachable_timeout          = 300 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.enforce_new_defaults = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.enforce_scope      = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.policy_default_rule = default {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.connection_string     = messaging:// {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.enabled               = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.es_doc_type           = notification {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.es_scroll_size        = 10000 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.es_scroll_time        = 2m {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.filter_error_trace    = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.hmac_keys             = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.sentinel_service_name = mymaster {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.socket_timeout        = 0.1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.trace_requests        = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler.trace_sqlalchemy      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler_jaeger.process_tags   = {} {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler_jaeger.service_name_prefix = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] profiler_otlp.service_name_prefix = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] remote_debug.host              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] remote_debug.port              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_notifications.retry = -1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.auth_section        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.auth_type           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.cafile              = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.certfile            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.collect_timing      = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.connect_retries     = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.connect_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.endpoint_id         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.endpoint_override   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.insecure            = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.keyfile             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.max_version         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.min_version         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.region_name         = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.service_name        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.service_type        = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.split_loggers       = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.status_code_retries = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.status_code_retry_delay = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.timeout             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.valid_interfaces    = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_limit.version             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_reports.file_event_handler = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] oslo_reports.log_dir           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.group  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] vif_plug_ovs_privileged.user   = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.isolate_vif         = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] os_brick.lock_path             = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.capabilities   = [21] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.group          = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.helper_command = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] privsep_osbrick.user           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.group           = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.helper_command  = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] nova_sys_admin.user            = None {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG oslo_service.service [None req-eaf74bd9-38b1-46f7-9dcb-78dac04b9d7a None None] ******************************************************************************** {{(pid=75051) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 24 18:48:01 user nova-compute[75051]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Connecting to libvirt: qemu:///system {{(pid=75051) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff6c17323b0> {{(pid=75051) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 24 18:48:01 user nova-compute[75051]: libvirt:  error : internal error: could not initialize domain event timer
Nov 24 18:48:01 user nova-compute[75051]: WARNING nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff6c17323b0> {{(pid=75051) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Starting native event thread {{(pid=75051) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Starting green dispatch thread {{(pid=75051) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Starting connection event dispatch thread {{(pid=75051) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 24 18:48:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Connection event '1' reason 'None'
Nov 24 18:48:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 24 18:48:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.mount [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Initialising _HostMountState generation 0 {{(pid=75051) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 24 18:48:08 user nova-compute[75051]: INFO nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host capabilities <capabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <host>
Nov 24 18:48:08 user nova-compute[75051]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 24 18:48:08 user nova-compute[75051]:     <cpu>
Nov 24 18:48:08 user nova-compute[75051]:       <arch>x86_64</arch>
Nov 24 18:48:08 user nova-compute[75051]:       <model>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <microcode version='1070'/>
Nov 24 18:48:08 user nova-compute[75051]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='osxsave'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='invtsc'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='rsba'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature name='skip-l1dfl-vmentry'/>
Nov 24 18:48:08 user nova-compute[75051]:       <pages unit='KiB' size='4'/>
Nov 24 18:48:08 user nova-compute[75051]:       <pages unit='KiB' size='2048'/>
Nov 24 18:48:08 user nova-compute[75051]:     </cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <power_management>
Nov 24 18:48:08 user nova-compute[75051]:       <suspend_mem/>
Nov 24 18:48:08 user nova-compute[75051]:       <suspend_disk/>
Nov 24 18:48:08 user nova-compute[75051]:       <suspend_hybrid/>
Nov 24 18:48:08 user nova-compute[75051]:     </power_management>
Nov 24 18:48:08 user nova-compute[75051]:     <iommu support='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <migration_features>
Nov 24 18:48:08 user nova-compute[75051]:       <live/>
Nov 24 18:48:08 user nova-compute[75051]:       <uri_transports>
Nov 24 18:48:08 user nova-compute[75051]:         <uri_transport>tcp</uri_transport>
Nov 24 18:48:08 user nova-compute[75051]:         <uri_transport>rdma</uri_transport>
Nov 24 18:48:08 user nova-compute[75051]:       </uri_transports>
Nov 24 18:48:08 user nova-compute[75051]:     </migration_features>
Nov 24 18:48:08 user nova-compute[75051]:     <topology>
Nov 24 18:48:08 user nova-compute[75051]:       <cells num='2'>
Nov 24 18:48:08 user nova-compute[75051]:         <cell id='0'>
Nov 24 18:48:08 user nova-compute[75051]:           <memory unit='KiB'>8189224</memory>
Nov 24 18:48:08 user nova-compute[75051]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 24 18:48:08 user nova-compute[75051]:           <pages unit='KiB' size='2048'>0</pages>
Nov 24 18:48:08 user nova-compute[75051]:           <distances>
Nov 24 18:48:08 user nova-compute[75051]:             <sibling id='0' value='10'/>
Nov 24 18:48:08 user nova-compute[75051]:             <sibling id='1' value='20'/>
Nov 24 18:48:08 user nova-compute[75051]:           </distances>
Nov 24 18:48:08 user nova-compute[75051]:           <cpus num='6'>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 24 18:48:08 user nova-compute[75051]:           </cpus>
Nov 24 18:48:08 user nova-compute[75051]:         </cell>
Nov 24 18:48:08 user nova-compute[75051]:         <cell id='1'>
Nov 24 18:48:08 user nova-compute[75051]:           <memory unit='KiB'>8206460</memory>
Nov 24 18:48:08 user nova-compute[75051]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 24 18:48:08 user nova-compute[75051]:           <pages unit='KiB' size='2048'>0</pages>
Nov 24 18:48:08 user nova-compute[75051]:           <distances>
Nov 24 18:48:08 user nova-compute[75051]:             <sibling id='0' value='20'/>
Nov 24 18:48:08 user nova-compute[75051]:             <sibling id='1' value='10'/>
Nov 24 18:48:08 user nova-compute[75051]:           </distances>
Nov 24 18:48:08 user nova-compute[75051]:           <cpus num='6'>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 24 18:48:08 user nova-compute[75051]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 24 18:48:08 user nova-compute[75051]:           </cpus>
Nov 24 18:48:08 user nova-compute[75051]:         </cell>
Nov 24 18:48:08 user nova-compute[75051]:       </cells>
Nov 24 18:48:08 user nova-compute[75051]:     </topology>
Nov 24 18:48:08 user nova-compute[75051]:     <cache>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 24 18:48:08 user nova-compute[75051]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 24 18:48:08 user nova-compute[75051]:     </cache>
Nov 24 18:48:08 user nova-compute[75051]:     <secmodel>
Nov 24 18:48:08 user nova-compute[75051]:       <model>apparmor</model>
Nov 24 18:48:08 user nova-compute[75051]:       <doi>0</doi>
Nov 24 18:48:08 user nova-compute[75051]:     </secmodel>
Nov 24 18:48:08 user nova-compute[75051]:     <secmodel>
Nov 24 18:48:08 user nova-compute[75051]:       <model>dac</model>
Nov 24 18:48:08 user nova-compute[75051]:       <doi>0</doi>
Nov 24 18:48:08 user nova-compute[75051]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 24 18:48:08 user nova-compute[75051]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 24 18:48:08 user nova-compute[75051]:     </secmodel>
Nov 24 18:48:08 user nova-compute[75051]:   </host>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='alpha'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>clipper</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='armv6l'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>spitz</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>nuri</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>kzm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>z2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>tosa</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n810</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>terrier</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>midway</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>microbit</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>verdex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>highbank</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>akita</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>connex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>collie</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='armv7l'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>spitz</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>nuri</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>kzm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>z2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>tosa</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n810</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>terrier</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>midway</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>microbit</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>verdex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>highbank</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>akita</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>connex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>collie</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='aarch64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>integratorcp</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>borzoi</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>spitz</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>nuri</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-b1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatileab</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>kzm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>musca-a</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>smdkc210</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>z2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>tosa</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>sabrelite</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-eb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n810</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>n800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>versatilepb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>terrier</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mainstone</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>midway</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>musicpal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>microbit</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cubieboard</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>verdex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduino2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>raspi3b</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>raspi2b</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>cheetah</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>highbank</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>akita</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>connex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>collie</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>raspi0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <acpi default='on' toggle='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='cris'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='i686'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>x-remote</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>isapc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>microvm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='kvm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <pae/>
Nov 24 18:48:08 user nova-compute[75051]:       <nonpae/>
Nov 24 18:48:08 user nova-compute[75051]:       <acpi default='on' toggle='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:       <apic default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='m68k'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>an5206</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>q800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>next-cube</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='microblaze'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='microblazeel'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='mips'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>malta</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='mipsel'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>malta</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='mips64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>malta</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>pica61</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>magnum</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='mips64el'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>malta</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mipssim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>pica61</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>magnum</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='16'>boston</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='ppc'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mac99</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>40p</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>taihu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='ppc64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>taihu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>40p</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mac99</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='ppc64le'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>taihu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ppce500</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>40p</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>pegasos2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>bamboo</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>g3beige</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>mac99</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sam460ex</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>ref405ep</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2048'>powernv8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='riscv32'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='8'>spike</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>opentitan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='5'>sifive_u</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sifive_e</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='8'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='riscv64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='8'>spike</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='5'>sifive_u</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>shakti_c</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sifive_e</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='8'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='s390x'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='sh4'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>shix</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>r2d</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='sh4eb'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>shix</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>r2d</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='sparc'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>SS-5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>SS-20</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>LX</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>SS-4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>SS-10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>Voyager</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='sparc64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sun4u</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>niagara</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>sun4v</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='x86_64'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>64</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>x-remote</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='1'>isapc</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>microvm</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='kvm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <acpi default='on' toggle='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:       <apic default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='xtensa'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>sim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>kc705</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ml605</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx200</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx60</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]:   <guest>
Nov 24 18:48:08 user nova-compute[75051]:     <os_type>hvm</os_type>
Nov 24 18:48:08 user nova-compute[75051]:     <arch name='xtensaeb'>
Nov 24 18:48:08 user nova-compute[75051]:       <wordsize>32</wordsize>
Nov 24 18:48:08 user nova-compute[75051]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='4'>sim</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>kc705</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ml605</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>virt</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx200</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>lx60</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 24 18:48:08 user nova-compute[75051]:       <domain type='qemu'/>
Nov 24 18:48:08 user nova-compute[75051]:     </arch>
Nov 24 18:48:08 user nova-compute[75051]:     <features>
Nov 24 18:48:08 user nova-compute[75051]:       <cpuselection/>
Nov 24 18:48:08 user nova-compute[75051]:       <deviceboot/>
Nov 24 18:48:08 user nova-compute[75051]:       <disksnapshot default='on' toggle='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     </features>
Nov 24 18:48:08 user nova-compute[75051]:   </guest>
Nov 24 18:48:08 user nova-compute[75051]: </capabilities>
Nov 24 18:48:08 user nova-compute[75051]: 
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-q35-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>i686</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='288'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'/>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='lm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-i440fx-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>i686</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='255'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'/>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='lm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ide</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-q35-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>i686</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='288'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'/>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='lm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-i386</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-i440fx-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>i686</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='255'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'/>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='lm'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ide</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-q35-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>x86_64</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='288'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>efi</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='invtsc'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='rsba'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-i440fx-6.2</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>x86_64</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='255'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>efi</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='invtsc'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='rsba'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ide</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-q35-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>x86_64</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='288'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>efi</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='invtsc'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='rsba'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 24 18:48:08 user nova-compute[75051]: <domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 24 18:48:08 user nova-compute[75051]:   <domain>kvm</domain>
Nov 24 18:48:08 user nova-compute[75051]:   <machine>pc-i440fx-jammy</machine>
Nov 24 18:48:08 user nova-compute[75051]:   <arch>x86_64</arch>
Nov 24 18:48:08 user nova-compute[75051]:   <vcpu max='255'/>
Nov 24 18:48:08 user nova-compute[75051]:   <iothreads supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:   <os supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='firmware'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>efi</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:     <loader supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>rom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pflash</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='readonly'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>yes</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='secure'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>no</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </loader>
Nov 24 18:48:08 user nova-compute[75051]:   </os>
Nov 24 18:48:08 user nova-compute[75051]:   <cpu>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-passthrough' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='hostPassthroughMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='maximum' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='maximumMigratable'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>on</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>off</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='host-model' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <vendor>Intel</vendor>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ss'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='vmx'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pcid'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='hypervisor'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arat'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='tsc_adjust'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='umip'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='md-clear'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='arch-capabilities'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='invtsc'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibpb'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='ibrs'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-stibp'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='amd-ssbd'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='rsba'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='require' name='pschange-mc-no'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='erms'/>
Nov 24 18:48:08 user nova-compute[75051]:       <feature policy='disable' name='xsaveopt'/>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:     <mode name='custom' supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>qemu64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>qemu32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>phenom</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>pentium</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>n270</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm64</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>kvm32</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>coreduo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>core2duo</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>athlon</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Westmere</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Snowridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Skylake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>SandyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Penryn</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G5</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G4</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G3</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Opteron_G2</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Opteron_G1</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>IvyBridge</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Icelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Haswell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Rome</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-Milan</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC-IBPB</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>EPYC</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Dhyana</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cooperlake</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>Conroe</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Cascadelake-Server</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-noTSX</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell-IBRS</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='no'>Broadwell</model>
Nov 24 18:48:08 user nova-compute[75051]:       <model usable='yes'>486</model>
Nov 24 18:48:08 user nova-compute[75051]:     </mode>
Nov 24 18:48:08 user nova-compute[75051]:   </cpu>
Nov 24 18:48:08 user nova-compute[75051]:   <memoryBacking supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:     <enum name='sourceType'>
Nov 24 18:48:08 user nova-compute[75051]:       <value>file</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>anonymous</value>
Nov 24 18:48:08 user nova-compute[75051]:       <value>memfd</value>
Nov 24 18:48:08 user nova-compute[75051]:     </enum>
Nov 24 18:48:08 user nova-compute[75051]:   </memoryBacking>
Nov 24 18:48:08 user nova-compute[75051]:   <devices>
Nov 24 18:48:08 user nova-compute[75051]:     <disk supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='diskDevice'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>disk</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cdrom</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>floppy</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>lun</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='bus'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ide</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>fdc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sata</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </disk>
Nov 24 18:48:08 user nova-compute[75051]:     <graphics supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='type'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>sdl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vnc</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>spice</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egl-headless</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </graphics>
Nov 24 18:48:08 user nova-compute[75051]:     <video supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='modelType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>cirrus</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>vmvga</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>qxl</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>none</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>bochs</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>ramfb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </video>
Nov 24 18:48:08 user nova-compute[75051]:     <hostdev supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='mode'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>subsystem</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='startupPolicy'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>default</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>mandatory</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>requisite</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>optional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='subsysType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>usb</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>pci</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>scsi</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='capsType'/>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='pciBackend'/>
Nov 24 18:48:08 user nova-compute[75051]:     </hostdev>
Nov 24 18:48:08 user nova-compute[75051]:     <rng supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtio-non-transitional</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>random</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>egd</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>builtin</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </rng>
Nov 24 18:48:08 user nova-compute[75051]:     <filesystem supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='driverType'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>path</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>handle</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>virtiofs</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </filesystem>
Nov 24 18:48:08 user nova-compute[75051]:     <tpm supported='yes'>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='model'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-tis</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>tpm-crb</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:       <enum name='backendModel'>
Nov 24 18:48:08 user nova-compute[75051]:         <value>passthrough</value>
Nov 24 18:48:08 user nova-compute[75051]:         <value>emulator</value>
Nov 24 18:48:08 user nova-compute[75051]:       </enum>
Nov 24 18:48:08 user nova-compute[75051]:     </tpm>
Nov 24 18:48:08 user nova-compute[75051]:   </devices>
Nov 24 18:48:08 user nova-compute[75051]:   <features>
Nov 24 18:48:08 user nova-compute[75051]:     <gic supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:     <vmcoreinfo supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <genid supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backingStoreInput supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <backup supported='yes'/>
Nov 24 18:48:08 user nova-compute[75051]:     <sev supported='no'/>
Nov 24 18:48:08 user nova-compute[75051]:   </features>
Nov 24 18:48:08 user nova-compute[75051]: </domainCapabilities>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75051) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75051) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Checking secure boot support for host arch (x86_64) {{(pid=75051) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 24 18:48:08 user nova-compute[75051]: INFO nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Secure Boot support detected
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] cpu compare xml: <cpu match="exact">
Nov 24 18:48:08 user nova-compute[75051]:   <model>Nehalem</model>
Nov 24 18:48:08 user nova-compute[75051]: </cpu>
Nov 24 18:48:08 user nova-compute[75051]:  {{(pid=75051) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 24 18:48:08 user nova-compute[75051]: INFO nova.virt.node [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Generated node identity f8429778-9501-4346-bab2-835efc6150b7
Nov 24 18:48:08 user nova-compute[75051]: INFO nova.virt.node [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Wrote node identity f8429778-9501-4346-bab2-835efc6150b7 to /opt/stack/data/nova/compute_id
Nov 24 18:48:08 user nova-compute[75051]: WARNING nova.compute.manager [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Compute nodes ['f8429778-9501-4346-bab2-835efc6150b7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 24 18:48:08 user nova-compute[75051]: INFO nova.compute.manager [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 24 18:48:08 user nova-compute[75051]: WARNING nova.compute.manager [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 24 18:48:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:48:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:48:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:48:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Hypervisor/Node resource view: name=user free_ram=10978MB free_disk=26.27376937866211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:48:09 user nova-compute[75051]: WARNING nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] No compute node record for user:f8429778-9501-4346-bab2-835efc6150b7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f8429778-9501-4346-bab2-835efc6150b7 could not be found.
Nov 24 18:48:09 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Compute node record created for user:user with uuid: f8429778-9501-4346-bab2-835efc6150b7
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:48:09 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] [req-3edf809d-1433-4fc4-8d81-a19a49660d1e] Created resource provider record via placement API for resource provider with UUID f8429778-9501-4346-bab2-835efc6150b7 and name user.
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75051) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 24 18:48:09 user nova-compute[75051]: INFO nova.virt.libvirt.host [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] kernel doesn't support AMD SEV
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Libvirt baseline CPU <cpu>
Nov 24 18:48:09 user nova-compute[75051]:   <arch>x86_64</arch>
Nov 24 18:48:09 user nova-compute[75051]:   <model>Nehalem</model>
Nov 24 18:48:09 user nova-compute[75051]:   <vendor>Intel</vendor>
Nov 24 18:48:09 user nova-compute[75051]:   <topology sockets="6" cores="1" threads="1"/>
Nov 24 18:48:09 user nova-compute[75051]: </cpu>
Nov 24 18:48:09 user nova-compute[75051]:  {{(pid=75051) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Updated inventory for provider f8429778-9501-4346-bab2-835efc6150b7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Updating resource provider f8429778-9501-4346-bab2-835efc6150b7 generation from 0 to 1 during operation: update_inventory {{(pid=75051) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Updating resource provider f8429778-9501-4346-bab2-835efc6150b7 generation from 1 to 2 during operation: update_traits {{(pid=75051) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.service [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Creating RPC server for service compute {{(pid=75051) start /opt/stack/nova/nova/service.py:182}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.service [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] Join ServiceGroup membership for this service compute {{(pid=75051) start /opt/stack/nova/nova/service.py:199}}
Nov 24 18:48:09 user nova-compute[75051]: DEBUG nova.servicegroup.drivers.db [None req-208a97e8-e493-4c3f-b7d8-071207e0b554 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75051) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 24 18:48:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:48:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:49:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:49:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:49:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=10412MB free_disk=26.177467346191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:49:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:50:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:50:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=10332MB free_disk=26.242576599121094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:50:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:50:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:50:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:51:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:51:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:51:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:51:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:51:01 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=10367MB free_disk=25.996631622314453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:51:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:51:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:52:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9657MB free_disk=26.023841857910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:52:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:52:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:12 user nova-compute[75051]: INFO nova.compute.claims [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Claim successful on node user
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Creating image(s)
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "/opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "/opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:14 user nova-compute[75051]: DEBUG nova.policy [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7977fbf6aa50419886a5bfc2e1fc8b63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e12bc28982604e84b0e547fd2021b02f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.part --force-share --output=json" returned: 0 in 0.216s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG nova.virt.images [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] 5493a48f-5fd1-4417-ad27-dfb869ec17c2 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.part /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:16 user nova-compute[75051]: INFO nova.compute.claims [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Claim successful on node user
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.part /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.converted" returned: 0 in 0.313s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.641s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:16 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppg1xg648/privsep.sock']
Nov 24 18:52:16 user sudo[84298]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppg1xg648/privsep.sock
Nov 24 18:52:16 user sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Creating image(s)
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "/opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:16 user nova-compute[75051]: DEBUG nova.policy [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88113529ca6747f281d4203c9c1d845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae7be1d57e44aae8c9b5695bba53ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:17 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Successfully created port: 241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:17 user sudo[84298]: pam_unix(sudo:session): session closed for user root
Nov 24 18:52:17 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Spawned new privsep daemon via rootwrap
Nov 24 18:52:17 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 18:52:17 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 18:52:17 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 24 18:52:17 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84301
Nov 24 18:52:17 user nova-compute[75051]: WARNING oslo_privsep.priv_context [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] privsep daemon already running
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk 1073741824" returned: 0 in 0.045s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.211s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.164s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Successfully created port: 0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk 1073741824" returned: 0 in 0.051s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Cannot resize image /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Ensure instance console log exists: /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.162s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Cannot resize image /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Ensure instance console log exists: /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:19 user nova-compute[75051]: INFO nova.compute.claims [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Claim successful on node user
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Creating image(s)
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.policy [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e4cb3329e664cf2b3452e4107df7060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233bc8e889de4ee8b6a00050bee74931', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.233s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk 1073741824" returned: 0 in 0.043s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Cannot resize image /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Ensure instance console log exists: /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Successfully updated port: 241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Successfully updated port: 0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquired lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-changed-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Refreshing instance network info cache due to event network-changed-0d367bf6-1610-4aa1-8a9a-6219d104d42b. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-changed-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Refreshing instance network info cache due to event network-changed-241bd5bb-67b6-49d0-9a92-1c3341d4797c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] Acquiring lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Instance network_info: |[{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Refreshing network info cache for port 0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Start _get_guest_xml network_info=[{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1274185594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1274185594',id=2,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-1dvitbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:17Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=f059e874-6d1f-436c-a798-94426b9d6490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:22 user nova-compute[75051]:   <uuid>f059e874-6d1f-436c-a798-94426b9d6490</uuid>
Nov 24 18:52:22 user nova-compute[75051]:   <name>instance-00000002</name>
Nov 24 18:52:22 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:22 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:22 user nova-compute[75051]:   <metadata>
Nov 24 18:52:22 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:22 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1274185594</nova:name>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:22</nova:creationTime>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:22 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:port uuid="0d367bf6-1610-4aa1-8a9a-6219d104d42b">
Nov 24 18:52:22 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 18:52:22 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:22 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:22 user nova-compute[75051]:   </metadata>
Nov 24 18:52:22 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:22 user nova-compute[75051]:     <system>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="serial">f059e874-6d1f-436c-a798-94426b9d6490</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="uuid">f059e874-6d1f-436c-a798-94426b9d6490</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:22 user nova-compute[75051]:     </system>
Nov 24 18:52:22 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:22 user nova-compute[75051]:   <os>
Nov 24 18:52:22 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:22 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:22 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:22 user nova-compute[75051]:   </os>
Nov 24 18:52:22 user nova-compute[75051]:   <features>
Nov 24 18:52:22 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:22 user nova-compute[75051]:     <apic/>
Nov 24 18:52:22 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:22 user nova-compute[75051]:   </features>
Nov 24 18:52:22 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:22 user nova-compute[75051]:   </clock>
Nov 24 18:52:22 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:22 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:22 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:22 user nova-compute[75051]:   </cpu>
Nov 24 18:52:22 user nova-compute[75051]:   <devices>
Nov 24 18:52:22 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:22 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:22 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk"/>
Nov 24 18:52:22 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:     </disk>
Nov 24 18:52:22 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:22 user nova-compute[75051]:       <mac address="fa:16:3e:e8:a3:2a"/>
Nov 24 18:52:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:22 user nova-compute[75051]:       <target dev="tap0d367bf6-16"/>
Nov 24 18:52:22 user nova-compute[75051]:     </interface>
Nov 24 18:52:22 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:22 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/console.log" append="off"/>
Nov 24 18:52:22 user nova-compute[75051]:     </serial>
Nov 24 18:52:22 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:22 user nova-compute[75051]:     <video>
Nov 24 18:52:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:     </video>
Nov 24 18:52:22 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:22 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:22 user nova-compute[75051]:     </rng>
Nov 24 18:52:22 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:22 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:22 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:22 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:22 user nova-compute[75051]:   </devices>
Nov 24 18:52:22 user nova-compute[75051]: </domain>
Nov 24 18:52:22 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1274185594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1274185594',id=2,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-1dvitbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:17Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=f059e874-6d1f-436c-a798-94426b9d6490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG os_vif [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Created schema index Interface.name {{(pid=75051) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Created schema index Port.name {{(pid=75051) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Created schema index Bridge.name {{(pid=75051) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [POLLOUT] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5897b9c-0a18-5d82-9724-a07740fd9d82', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:22 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpeirlqkbd/privsep.sock']
Nov 24 18:52:22 user sudo[84390]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpeirlqkbd/privsep.sock
Nov 24 18:52:22 user sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating instance_info_cache with network_info: [{"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Releasing lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Instance network_info: |[{"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] Acquired lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Refreshing network info cache for port 241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Start _get_guest_xml network_info=[{"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1527989276',display_name='tempest-DeleteServersTestJSON-server-1527989276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1527989276',id=1,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12bc28982604e84b0e547fd2021b02f',ramdisk_id='',reservation_id='r-b38loojj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-270965211',owner_user_name='tempest-DeleteServersTestJSON-270965211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:14Z,user_data=None,user_id='7977fbf6aa50419886a5bfc2e1fc8b63',uuid=fe0ec57a-6937-4277-a62f-22aa0622d06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converting VIF {"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lazy-loading 'pci_devices' on Instance uuid fe0ec57a-6937-4277-a62f-22aa0622d06e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:22 user nova-compute[75051]:   <uuid>fe0ec57a-6937-4277-a62f-22aa0622d06e</uuid>
Nov 24 18:52:22 user nova-compute[75051]:   <name>instance-00000001</name>
Nov 24 18:52:22 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:22 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:22 user nova-compute[75051]:   <metadata>
Nov 24 18:52:22 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:22 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:name>tempest-DeleteServersTestJSON-server-1527989276</nova:name>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:22</nova:creationTime>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:22 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:user uuid="7977fbf6aa50419886a5bfc2e1fc8b63">tempest-DeleteServersTestJSON-270965211-project-member</nova:user>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:project uuid="e12bc28982604e84b0e547fd2021b02f">tempest-DeleteServersTestJSON-270965211</nova:project>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:22 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:22 user nova-compute[75051]:         <nova:port uuid="241bd5bb-67b6-49d0-9a92-1c3341d4797c">
Nov 24 18:52:22 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 18:52:22 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:22 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:22 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:22 user nova-compute[75051]:   </metadata>
Nov 24 18:52:22 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:22 user nova-compute[75051]:     <system>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="serial">fe0ec57a-6937-4277-a62f-22aa0622d06e</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="uuid">fe0ec57a-6937-4277-a62f-22aa0622d06e</entry>
Nov 24 18:52:22 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:22 user nova-compute[75051]:     </system>
Nov 24 18:52:22 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:22 user nova-compute[75051]:   <os>
Nov 24 18:52:22 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:22 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:22 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:22 user nova-compute[75051]:   </os>
Nov 24 18:52:22 user nova-compute[75051]:   <features>
Nov 24 18:52:22 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:22 user nova-compute[75051]:     <apic/>
Nov 24 18:52:22 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:22 user nova-compute[75051]:   </features>
Nov 24 18:52:22 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:22 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:22 user nova-compute[75051]:   </clock>
Nov 24 18:52:22 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:22 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:22 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:22 user nova-compute[75051]:   </cpu>
Nov 24 18:52:22 user nova-compute[75051]:   <devices>
Nov 24 18:52:22 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:22 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:22 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk"/>
Nov 24 18:52:22 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:     </disk>
Nov 24 18:52:22 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:22 user nova-compute[75051]:       <mac address="fa:16:3e:33:3c:25"/>
Nov 24 18:52:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:22 user nova-compute[75051]:       <target dev="tap241bd5bb-67"/>
Nov 24 18:52:22 user nova-compute[75051]:     </interface>
Nov 24 18:52:22 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:22 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/console.log" append="off"/>
Nov 24 18:52:22 user nova-compute[75051]:     </serial>
Nov 24 18:52:22 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:22 user nova-compute[75051]:     <video>
Nov 24 18:52:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:22 user nova-compute[75051]:     </video>
Nov 24 18:52:22 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:22 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:22 user nova-compute[75051]:     </rng>
Nov 24 18:52:22 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:22 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:22 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:22 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:22 user nova-compute[75051]:   </devices>
Nov 24 18:52:22 user nova-compute[75051]: </domain>
Nov 24 18:52:22 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1527989276',display_name='tempest-DeleteServersTestJSON-server-1527989276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1527989276',id=1,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e12bc28982604e84b0e547fd2021b02f',ramdisk_id='',reservation_id='r-b38loojj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-270965211',owner_user_name='tempest-DeleteServersTestJSON-270965211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:14Z,user_data=None,user_id='7977fbf6aa50419886a5bfc2e1fc8b63',uuid=fe0ec57a-6937-4277-a62f-22aa0622d06e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converting VIF {"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG os_vif [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7667d70a-e6bb-5436-83bc-02ee115cd295', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updated VIF entry in instance network info cache for port 0d367bf6-1610-4aa1-8a9a-6219d104d42b. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef722bcc-48e7-4b56-805d-e87b872e6215 req-4d64833e-c006-4690-a0e1-2a2ecd06ffc6 service nova] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Successfully created port: 3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:23 user sudo[84390]: pam_unix(sudo:session): session closed for user root
Nov 24 18:52:23 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Spawned new privsep daemon via rootwrap
Nov 24 18:52:23 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 18:52:23 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 18:52:23 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 24 18:52:23 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84397
Nov 24 18:52:23 user nova-compute[75051]: WARNING oslo_privsep.priv_context [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] privsep daemon already running
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d367bf6-16, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d367bf6-16, col_values=(('qos', UUID('06a732f2-4a88-44f2-a953-f8ae7571210b')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d367bf6-16, col_values=(('external_ids', {'iface-id': '0d367bf6-1610-4aa1-8a9a-6219d104d42b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:a3:2a', 'vm-uuid': 'f059e874-6d1f-436c-a798-94426b9d6490'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: INFO os_vif [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16')
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap241bd5bb-67, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap241bd5bb-67, col_values=(('qos', UUID('3f808be6-cb0c-4e6a-95af-a282477a874e')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap241bd5bb-67, col_values=(('external_ids', {'iface-id': '241bd5bb-67b6-49d0-9a92-1c3341d4797c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3c:25', 'vm-uuid': 'fe0ec57a-6937-4277-a62f-22aa0622d06e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:e8:a3:2a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:24 user nova-compute[75051]: INFO os_vif [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67')
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] No VIF found with MAC fa:16:3e:33:3c:25, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updated VIF entry in instance network info cache for port 241bd5bb-67b6-49d0-9a92-1c3341d4797c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating instance_info_cache with network_info: [{"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d546fc4-de9d-4c1b-a453-aca0dddf0fe9 req-49466939-d7ea-4a0b-8e23-b881d0246800 service nova] Releasing lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:25 user nova-compute[75051]: INFO nova.compute.claims [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Claim successful on node user
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:25 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Creating image(s)
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.policy [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53abab4c5b7b48e0a4a857472ed46245', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fa4b8bd2840427cbbc401ebe27fd1ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.205s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk 1073741824" returned: 0 in 0.047s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Cannot resize image /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Successfully updated port: 3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-changed-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Refreshing instance network info cache due to event network-changed-3477becc-b128-4274-84c5-37633e88d5eb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:52:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Instance spawned successfully.
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:52:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Instance spawned successfully.
Nov 24 18:52:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:29 user nova-compute[75051]: INFO nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Took 15.35 seconds to spawn the instance on the hypervisor.
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:52:29 user nova-compute[75051]: INFO nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Took 12.41 seconds to spawn the instance on the hypervisor.
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance network_info: |[{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Refreshing network info cache for port 3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start _get_guest_xml network_info=[{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:29 user nova-compute[75051]: INFO nova.compute.manager [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Took 16.81 seconds to build instance.
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'pci_devices' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037312b4-e43e-4f8d-accb-c1eb8dc34fb9 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.180s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:29 user nova-compute[75051]: INFO nova.compute.manager [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Took 13.48 seconds to build instance.
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:29 user nova-compute[75051]:   <uuid>451ff98d-318a-4a05-a612-e3ce527d1164</uuid>
Nov 24 18:52:29 user nova-compute[75051]:   <name>instance-00000003</name>
Nov 24 18:52:29 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:29 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:29 user nova-compute[75051]:   <metadata>
Nov 24 18:52:29 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:29 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherB-server-1162642123</nova:name>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:29</nova:creationTime>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:29 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:29 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:user uuid="5e4cb3329e664cf2b3452e4107df7060">tempest-ServerActionsTestOtherB-355305494-project-member</nova:user>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:project uuid="233bc8e889de4ee8b6a00050bee74931">tempest-ServerActionsTestOtherB-355305494</nova:project>
Nov 24 18:52:29 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:29 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:29 user nova-compute[75051]:         <nova:port uuid="3477becc-b128-4274-84c5-37633e88d5eb">
Nov 24 18:52:29 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 18:52:29 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:29 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:29 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:29 user nova-compute[75051]:   </metadata>
Nov 24 18:52:29 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:29 user nova-compute[75051]:     <system>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="serial">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="uuid">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:52:29 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:29 user nova-compute[75051]:     </system>
Nov 24 18:52:29 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:29 user nova-compute[75051]:   <os>
Nov 24 18:52:29 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:29 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:29 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:29 user nova-compute[75051]:   </os>
Nov 24 18:52:29 user nova-compute[75051]:   <features>
Nov 24 18:52:29 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:29 user nova-compute[75051]:     <apic/>
Nov 24 18:52:29 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:29 user nova-compute[75051]:   </features>
Nov 24 18:52:29 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:29 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:29 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:29 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:29 user nova-compute[75051]:   </clock>
Nov 24 18:52:29 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:29 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:29 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:29 user nova-compute[75051]:   </cpu>
Nov 24 18:52:29 user nova-compute[75051]:   <devices>
Nov 24 18:52:29 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:29 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:29 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk"/>
Nov 24 18:52:29 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:29 user nova-compute[75051]:     </disk>
Nov 24 18:52:29 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:29 user nova-compute[75051]:       <mac address="fa:16:3e:84:5f:4d"/>
Nov 24 18:52:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:29 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:29 user nova-compute[75051]:       <target dev="tap3477becc-b1"/>
Nov 24 18:52:29 user nova-compute[75051]:     </interface>
Nov 24 18:52:29 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:29 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/console.log" append="off"/>
Nov 24 18:52:29 user nova-compute[75051]:     </serial>
Nov 24 18:52:29 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:29 user nova-compute[75051]:     <video>
Nov 24 18:52:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:29 user nova-compute[75051]:     </video>
Nov 24 18:52:29 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:29 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:29 user nova-compute[75051]:     </rng>
Nov 24 18:52:29 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:29 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:29 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:29 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:29 user nova-compute[75051]:   </devices>
Nov 24 18:52:29 user nova-compute[75051]: </domain>
Nov 24 18:52:29 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG os_vif [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd68b916f-616c-5b49-80cf-8a560c842f93', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3477becc-b1, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3477becc-b1, col_values=(('qos', UUID('04184713-4a5e-4e11-af55-738387460df4')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3477becc-b1, col_values=(('external_ids', {'iface-id': '3477becc-b128-4274-84c5-37633e88d5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:5f:4d', 'vm-uuid': '451ff98d-318a-4a05-a612-e3ce527d1164'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfd0562e-60d8-40e3-9809-d4f70cb1cb81 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.657s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:29 user nova-compute[75051]: INFO os_vif [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No VIF found with MAC fa:16:3e:84:5f:4d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Successfully created port: b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updated VIF entry in instance network info cache for port 3477becc-b128-4274-84c5-37633e88d5eb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bfc67b17-71d8-42ef-bace-4cc30cb15c12 req-acb0d2d5-1cbd-4a90-9122-8ce84bab0142 service nova] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:32 user nova-compute[75051]: WARNING nova.compute.manager [req-6666f6da-837d-42cb-8651-9881322e9ec2 req-b924203f-d5ca-4d2b-aac6-cc3c3b3bb495 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state active and task_state None.
Nov 24 18:52:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Successfully updated port: b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing instance network info cache due to event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:52:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance spawned successfully.
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:34 user nova-compute[75051]: INFO nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Took 14.13 seconds to spawn the instance on the hypervisor.
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:52:34 user nova-compute[75051]: INFO nova.compute.manager [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Took 14.89 seconds to build instance.
Nov 24 18:52:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9600ac81-9c6b-4fe3-88ef-832e487e2bba tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.042s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance network_info: |[{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.neutron [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start _get_guest_xml network_info=[{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:34 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:34 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1631843319',display_name='tempest-ServerStableDeviceRescueTest-server-1631843319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1631843319',id=4,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp6SKZOIk+xReUl8mqhN/wc+R9+FUSmRXe8SoZ5JpOd1MFMSYZgsTsZKQs9P3kqS/r0bz/IP7rh+BDsdP1qH9x/syg2R/G2CIjxRgK03I7wiQ4OP1cOL3umm3BIS5g18w==',key_name='tempest-keypair-991358245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fa4b8bd2840427cbbc401ebe27fd1ef',ramdisk_id='',reservation_id='r-4cvaj118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1493484384',owner_user_name='tempest-ServerStableDeviceRescueTest-1493484384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53abab4c5b7b48e0a4a857472ed46245',uuid=4667ca1f-edc2-49d3-a2d0-3112bf186a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converting VIF {"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.objects.instance [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'pci_devices' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:34 user nova-compute[75051]:   <uuid>4667ca1f-edc2-49d3-a2d0-3112bf186a1d</uuid>
Nov 24 18:52:34 user nova-compute[75051]:   <name>instance-00000004</name>
Nov 24 18:52:34 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:34 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:34 user nova-compute[75051]:   <metadata>
Nov 24 18:52:34 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:34 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1631843319</nova:name>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:34</nova:creationTime>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:34 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:34 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:user uuid="53abab4c5b7b48e0a4a857472ed46245">tempest-ServerStableDeviceRescueTest-1493484384-project-member</nova:user>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:project uuid="2fa4b8bd2840427cbbc401ebe27fd1ef">tempest-ServerStableDeviceRescueTest-1493484384</nova:project>
Nov 24 18:52:34 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:34 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:34 user nova-compute[75051]:         <nova:port uuid="b24c4402-fb02-4205-9ee8-d414e41210ea">
Nov 24 18:52:34 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:52:34 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:34 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:34 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:34 user nova-compute[75051]:   </metadata>
Nov 24 18:52:34 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:34 user nova-compute[75051]:     <system>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="serial">4667ca1f-edc2-49d3-a2d0-3112bf186a1d</entry>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="uuid">4667ca1f-edc2-49d3-a2d0-3112bf186a1d</entry>
Nov 24 18:52:34 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:34 user nova-compute[75051]:     </system>
Nov 24 18:52:34 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:34 user nova-compute[75051]:   <os>
Nov 24 18:52:34 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:34 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:34 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:34 user nova-compute[75051]:   </os>
Nov 24 18:52:34 user nova-compute[75051]:   <features>
Nov 24 18:52:34 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:34 user nova-compute[75051]:     <apic/>
Nov 24 18:52:34 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:34 user nova-compute[75051]:   </features>
Nov 24 18:52:34 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:34 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:34 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:34 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:34 user nova-compute[75051]:   </clock>
Nov 24 18:52:34 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:34 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:34 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:34 user nova-compute[75051]:   </cpu>
Nov 24 18:52:34 user nova-compute[75051]:   <devices>
Nov 24 18:52:34 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:34 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:34 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk"/>
Nov 24 18:52:34 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:34 user nova-compute[75051]:     </disk>
Nov 24 18:52:34 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:34 user nova-compute[75051]:       <mac address="fa:16:3e:b9:41:3d"/>
Nov 24 18:52:34 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:34 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:34 user nova-compute[75051]:       <target dev="tapb24c4402-fb"/>
Nov 24 18:52:34 user nova-compute[75051]:     </interface>
Nov 24 18:52:34 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:34 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/console.log" append="off"/>
Nov 24 18:52:34 user nova-compute[75051]:     </serial>
Nov 24 18:52:34 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:34 user nova-compute[75051]:     <video>
Nov 24 18:52:34 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:34 user nova-compute[75051]:     </video>
Nov 24 18:52:34 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:34 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:34 user nova-compute[75051]:     </rng>
Nov 24 18:52:34 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:34 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:34 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:34 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:34 user nova-compute[75051]:   </devices>
Nov 24 18:52:34 user nova-compute[75051]: </domain>
Nov 24 18:52:34 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1631843319',display_name='tempest-ServerStableDeviceRescueTest-server-1631843319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1631843319',id=4,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp6SKZOIk+xReUl8mqhN/wc+R9+FUSmRXe8SoZ5JpOd1MFMSYZgsTsZKQs9P3kqS/r0bz/IP7rh+BDsdP1qH9x/syg2R/G2CIjxRgK03I7wiQ4OP1cOL3umm3BIS5g18w==',key_name='tempest-keypair-991358245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fa4b8bd2840427cbbc401ebe27fd1ef',ramdisk_id='',reservation_id='r-4cvaj118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1493484384',owner_user_name='tempest-ServerStableDeviceRescueTest-1493484384-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53abab4c5b7b48e0a4a857472ed46245',uuid=4667ca1f-edc2-49d3-a2d0-3112bf186a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converting VIF {"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG os_vif [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dc9e552-78f1-53cc-ba0a-3cb6dbc3c4aa', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb24c4402-fb, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb24c4402-fb, col_values=(('qos', UUID('b2a8e821-c471-49ce-a386-e707ad4d3ba3')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb24c4402-fb, col_values=(('external_ids', {'iface-id': 'b24c4402-fb02-4205-9ee8-d414e41210ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:41:3d', 'vm-uuid': '4667ca1f-edc2-49d3-a2d0-3112bf186a1d'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:34 user nova-compute[75051]: INFO os_vif [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb')
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No VIF found with MAC fa:16:3e:b9:41:3d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:35 user nova-compute[75051]: WARNING nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state active and task_state None.
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] No waiting events found dispatching network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:35 user nova-compute[75051]: WARNING nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received unexpected event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c for instance with vm_state active and task_state None.
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] No waiting events found dispatching network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:35 user nova-compute[75051]: WARNING nova.compute.manager [req-9db547cb-b516-4aa8-a597-3e0c580becf9 req-0898ef9b-1cd8-421b-814c-b12a286ed0b0 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received unexpected event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c for instance with vm_state active and task_state None.
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updated VIF entry in instance network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6c8e214-fe1d-49c4-a67b-839b84d6a903 req-16752c2e-824f-495f-ae2c-5653d0db501f service nova] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:52:39 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance spawned successfully.
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:40 user nova-compute[75051]: INFO nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Took 14.24 seconds to spawn the instance on the hypervisor.
Nov 24 18:52:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:52:40 user nova-compute[75051]: INFO nova.compute.manager [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Took 15.10 seconds to build instance.
Nov 24 18:52:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-557c6559-84ce-4066-8cd4-175fc68cac27 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.256s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:41 user nova-compute[75051]: INFO nova.compute.claims [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Claim successful on node user
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.policy [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fc348da26af46129290241674d373d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90fc5236fe074402a3e6ea23353b7677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Creating image(s)
Nov 24 18:52:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "/opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "/opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.207s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk 1073741824" returned: 0 in 0.074s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Successfully created port: 7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.252s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Cannot resize image /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Ensure instance console log exists: /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Successfully updated port: 7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquired lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-changed-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Refreshing instance network info cache due to event network-changed-7cd6266f-d44e-44a9-8033-3e977fe8e3a0. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] Acquiring lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updating instance_info_cache with network_info: [{"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Releasing lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Instance network_info: |[{"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] Acquired lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Refreshing network info cache for port 7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Start _get_guest_xml network_info=[{"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-390187256',display_name='tempest-VolumesAssistedSnapshotsTest-server-390187256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-390187256',id=5,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQz+uQFNPW7scqkOWuoiaEF/3AD/NqlWEhNnOAL3NTNKVRoQd3C5qyb5a+0FnGkonXwwTpu7mMT++t4H1TtbYYLAa1KmNsBZYYmhm94FMwoPiZCotvrVU5kr8sld/Tkkw==',key_name='tempest-keypair-544936102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90fc5236fe074402a3e6ea23353b7677',ramdisk_id='',reservation_id='r-rs7ic1vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1472399647',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1472399647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fc348da26af46129290241674d373d3',uuid=e0d31370-4bdb-4804-b1d5-5e4a19a41912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converting VIF {"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lazy-loading 'pci_devices' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:46 user nova-compute[75051]:   <uuid>e0d31370-4bdb-4804-b1d5-5e4a19a41912</uuid>
Nov 24 18:52:46 user nova-compute[75051]:   <name>instance-00000005</name>
Nov 24 18:52:46 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:46 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:46 user nova-compute[75051]:   <metadata>
Nov 24 18:52:46 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:46 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-390187256</nova:name>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:46</nova:creationTime>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:46 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:46 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:user uuid="3fc348da26af46129290241674d373d3">tempest-VolumesAssistedSnapshotsTest-1472399647-project-member</nova:user>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:project uuid="90fc5236fe074402a3e6ea23353b7677">tempest-VolumesAssistedSnapshotsTest-1472399647</nova:project>
Nov 24 18:52:46 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:46 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:46 user nova-compute[75051]:         <nova:port uuid="7cd6266f-d44e-44a9-8033-3e977fe8e3a0">
Nov 24 18:52:46 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 18:52:46 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:46 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:46 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:46 user nova-compute[75051]:   </metadata>
Nov 24 18:52:46 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:46 user nova-compute[75051]:     <system>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="serial">e0d31370-4bdb-4804-b1d5-5e4a19a41912</entry>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="uuid">e0d31370-4bdb-4804-b1d5-5e4a19a41912</entry>
Nov 24 18:52:46 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:46 user nova-compute[75051]:     </system>
Nov 24 18:52:46 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:46 user nova-compute[75051]:   <os>
Nov 24 18:52:46 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:46 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:46 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:46 user nova-compute[75051]:   </os>
Nov 24 18:52:46 user nova-compute[75051]:   <features>
Nov 24 18:52:46 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:46 user nova-compute[75051]:     <apic/>
Nov 24 18:52:46 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:46 user nova-compute[75051]:   </features>
Nov 24 18:52:46 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:46 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:46 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:46 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:46 user nova-compute[75051]:   </clock>
Nov 24 18:52:46 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:46 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:46 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:46 user nova-compute[75051]:   </cpu>
Nov 24 18:52:46 user nova-compute[75051]:   <devices>
Nov 24 18:52:46 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:46 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:46 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk"/>
Nov 24 18:52:46 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:46 user nova-compute[75051]:     </disk>
Nov 24 18:52:46 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:46 user nova-compute[75051]:       <mac address="fa:16:3e:29:aa:8a"/>
Nov 24 18:52:46 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:46 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:46 user nova-compute[75051]:       <target dev="tap7cd6266f-d4"/>
Nov 24 18:52:46 user nova-compute[75051]:     </interface>
Nov 24 18:52:46 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:46 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/console.log" append="off"/>
Nov 24 18:52:46 user nova-compute[75051]:     </serial>
Nov 24 18:52:46 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:46 user nova-compute[75051]:     <video>
Nov 24 18:52:46 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:46 user nova-compute[75051]:     </video>
Nov 24 18:52:46 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:46 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:46 user nova-compute[75051]:     </rng>
Nov 24 18:52:46 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:46 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:46 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:46 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:46 user nova-compute[75051]:   </devices>
Nov 24 18:52:46 user nova-compute[75051]: </domain>
Nov 24 18:52:46 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-390187256',display_name='tempest-VolumesAssistedSnapshotsTest-server-390187256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-390187256',id=5,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQz+uQFNPW7scqkOWuoiaEF/3AD/NqlWEhNnOAL3NTNKVRoQd3C5qyb5a+0FnGkonXwwTpu7mMT++t4H1TtbYYLAa1KmNsBZYYmhm94FMwoPiZCotvrVU5kr8sld/Tkkw==',key_name='tempest-keypair-544936102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90fc5236fe074402a3e6ea23353b7677',ramdisk_id='',reservation_id='r-rs7ic1vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1472399647',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1472399647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fc348da26af46129290241674d373d3',uuid=e0d31370-4bdb-4804-b1d5-5e4a19a41912,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converting VIF {"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG os_vif [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59270b20-1e8b-5808-a173-f640f582a633', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cd6266f-d4, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cd6266f-d4, col_values=(('qos', UUID('2d1850d2-d689-4b1e-b4e3-fb130cd90f02')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cd6266f-d4, col_values=(('external_ids', {'iface-id': '7cd6266f-d44e-44a9-8033-3e977fe8e3a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:aa:8a', 'vm-uuid': 'e0d31370-4bdb-4804-b1d5-5e4a19a41912'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:46 user nova-compute[75051]: INFO nova.compute.claims [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Claim successful on node user
Nov 24 18:52:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:46 user nova-compute[75051]: INFO os_vif [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4')
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] No VIF found with MAC fa:16:3e:29:aa:8a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:46 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updated VIF entry in instance network info cache for port 7cd6266f-d44e-44a9-8033-3e977fe8e3a0. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updating instance_info_cache with network_info: [{"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55a8d837-fff7-4628-b856-9f2628bf4572 req-bac2b0d1-717a-401b-be35-8213a687eb4b service nova] Releasing lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:47 user nova-compute[75051]: INFO nova.compute.claims [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Claim successful on node user
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.policy [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14001a6e46b9400b83132cdcca29e31f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54c56b6e4e2747a79682208777045231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Creating image(s)
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "/opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "/opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.212s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.359s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk 1073741824" returned: 0 in 0.066s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:47 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:47 user nova-compute[75051]: INFO nova.compute.claims [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Claim successful on node user
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.227s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.policy [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecfb56e8f1ba48fc9a5d2d454a9d71c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86489e5f33d24e35bff96a224cc4c778', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Cannot resize image /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Ensure instance console log exists: /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Successfully created port: d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] No waiting events found dispatching network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:48 user nova-compute[75051]: WARNING nova.compute.manager [req-eec41ba5-f32d-4723-abd5-721cc0a20d3a req-d433f793-e811-417f-ac02-0f8daca24abe service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received unexpected event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 for instance with vm_state building and task_state spawning.
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Creating image(s)
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.part --force-share --output=json" returned: 0 in 0.215s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.virt.images [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] e8ea8490-0a56-4692-bcd3-bf4396265d41 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.part /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.588s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.part /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.converted" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.policy [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acd941243b164658bf180f3c31cb732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977597f2a324ed4ba4ca3794b12957f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.168s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Successfully created port: 023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:52:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Creating image(s)
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json" returned: 0 in 0.253s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Successfully updated port: d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-changed-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Refreshing instance network info cache due to event network-changed-d7abb801-e462-4749-8349-13f953f5d61b. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] Acquiring lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] Acquired lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Refreshing network info cache for port d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.263s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json" returned: 0 in 0.255s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6,backing_fmt=raw /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Successfully created port: 100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6,backing_fmt=raw /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk 1073741824" returned: 0 in 0.103s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "cfa47b07ef6c66f67237e3e93e5ce52ea07668e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.246s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk 1073741824" returned: 0 in 0.054s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Instance spawned successfully.
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] No waiting events found dispatching network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:50 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d16db6-7f8f-4dbb-a03e-f5013e71a806 req-4f689cf6-efec-45b7-8e69-71cfde0c7528 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received unexpected event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 for instance with vm_state building and task_state spawning.
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 --force-share --output=json" returned: 0 in 0.252s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: INFO nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Took 7.83 seconds to spawn the instance on the hypervisor.
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.232s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Checking if we can resize image /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:50 user nova-compute[75051]: INFO nova.compute.manager [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Took 9.00 seconds to build instance.
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6a9f8a31-f0b6-43d7-bb25-ce16e022d406 tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.130s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Cannot resize image /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Ensure instance console log exists: /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Cannot resize image /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Ensure instance console log exists: /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Successfully updated port: 100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8f90ecef-62f1-40fa-9556-2687887b2158 req-5fe4eb1e-8281-4bfc-80e5-b49a6f6f2abe service nova] Releasing lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquired lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Instance network_info: |[{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Start _get_guest_xml network_info=[{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'pci_devices' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Successfully updated port: 023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:51 user nova-compute[75051]:   <uuid>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</uuid>
Nov 24 18:52:51 user nova-compute[75051]:   <name>instance-00000008</name>
Nov 24 18:52:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:51 user nova-compute[75051]:   <metadata>
Nov 24 18:52:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:51</nova:creationTime>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:52:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:52:51 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:51 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:51 user nova-compute[75051]:   </metadata>
Nov 24 18:52:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:51 user nova-compute[75051]:     <system>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="serial">197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="uuid">197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:51 user nova-compute[75051]:     </system>
Nov 24 18:52:51 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:51 user nova-compute[75051]:   <os>
Nov 24 18:52:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:51 user nova-compute[75051]:   </os>
Nov 24 18:52:51 user nova-compute[75051]:   <features>
Nov 24 18:52:51 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:51 user nova-compute[75051]:     <apic/>
Nov 24 18:52:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:51 user nova-compute[75051]:   </features>
Nov 24 18:52:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:51 user nova-compute[75051]:   </clock>
Nov 24 18:52:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:51 user nova-compute[75051]:   </cpu>
Nov 24 18:52:51 user nova-compute[75051]:   <devices>
Nov 24 18:52:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk"/>
Nov 24 18:52:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:     </disk>
Nov 24 18:52:51 user nova-compute[75051]:     <disk type="file" device="cdrom">
Nov 24 18:52:51 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 18:52:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config"/>
Nov 24 18:52:51 user nova-compute[75051]:       <target dev="hda" bus="ide"/>
Nov 24 18:52:51 user nova-compute[75051]:     </disk>
Nov 24 18:52:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:51 user nova-compute[75051]:       <mac address="fa:16:3e:6b:7b:1b"/>
Nov 24 18:52:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:51 user nova-compute[75051]:       <target dev="tap100a87c1-4a"/>
Nov 24 18:52:51 user nova-compute[75051]:     </interface>
Nov 24 18:52:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log" append="off"/>
Nov 24 18:52:51 user nova-compute[75051]:     </serial>
Nov 24 18:52:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:51 user nova-compute[75051]:     <video>
Nov 24 18:52:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:     </video>
Nov 24 18:52:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:51 user nova-compute[75051]:     </rng>
Nov 24 18:52:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:51 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:51 user nova-compute[75051]:   </devices>
Nov 24 18:52:51 user nova-compute[75051]: </domain>
Nov 24 18:52:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG os_vif [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquired lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad70d542-a8e0-51aa-adb1-b9aeac550b56', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap100a87c1-4a, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap100a87c1-4a, col_values=(('qos', UUID('f3a0b616-9ae3-4955-8114-976f40bbe8f7')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap100a87c1-4a, col_values=(('external_ids', {'iface-id': '100a87c1-4a68-4946-a293-96ace9269687', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7b:1b', 'vm-uuid': '197a4531-4f1f-40b1-b8b9-03a2ad5e47bd'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: INFO os_vif [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a')
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name hda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No VIF found with MAC fa:16:3e:6b:7b:1b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:51 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Using config drive
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updating instance_info_cache with network_info: [{"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Releasing lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance network_info: |[{"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Start _get_guest_xml network_info=[{"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780787285',display_name='tempest-TestVolumeSwap-server-1780787285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780787285',id=6,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuc3dXEODIsjD1N+lB4qnDxsB96ThbmvHGUw/haqk1ovJMKxSredwzkFEVGQnJNpseVXW1drhrFZ7CwmrilhB4FghiTQJQVjaecDESNpcw78xvkoAs1alAbkY9eRtlJqw==',key_name='tempest-keypair-1587869462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c56b6e4e2747a79682208777045231',ramdisk_id='',reservation_id='r-plzo3x3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1784958988',owner_user_name='tempest-TestVolumeSwap-1784958988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14001a6e46b9400b83132cdcca29e31f',uuid=f0410591-5d5c-473a-93a9-283730abc348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converting VIF {"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lazy-loading 'pci_devices' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:51 user nova-compute[75051]:   <uuid>f0410591-5d5c-473a-93a9-283730abc348</uuid>
Nov 24 18:52:51 user nova-compute[75051]:   <name>instance-00000006</name>
Nov 24 18:52:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:51 user nova-compute[75051]:   <metadata>
Nov 24 18:52:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:name>tempest-TestVolumeSwap-server-1780787285</nova:name>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:51</nova:creationTime>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:user uuid="14001a6e46b9400b83132cdcca29e31f">tempest-TestVolumeSwap-1784958988-project-member</nova:user>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:project uuid="54c56b6e4e2747a79682208777045231">tempest-TestVolumeSwap-1784958988</nova:project>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:52:51 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:51 user nova-compute[75051]:         <nova:port uuid="d7abb801-e462-4749-8349-13f953f5d61b">
Nov 24 18:52:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:52:51 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:51 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:51 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:51 user nova-compute[75051]:   </metadata>
Nov 24 18:52:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:51 user nova-compute[75051]:     <system>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="serial">f0410591-5d5c-473a-93a9-283730abc348</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="uuid">f0410591-5d5c-473a-93a9-283730abc348</entry>
Nov 24 18:52:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:51 user nova-compute[75051]:     </system>
Nov 24 18:52:51 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:51 user nova-compute[75051]:   <os>
Nov 24 18:52:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:51 user nova-compute[75051]:   </os>
Nov 24 18:52:51 user nova-compute[75051]:   <features>
Nov 24 18:52:51 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:51 user nova-compute[75051]:     <apic/>
Nov 24 18:52:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:51 user nova-compute[75051]:   </features>
Nov 24 18:52:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:51 user nova-compute[75051]:   </clock>
Nov 24 18:52:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:51 user nova-compute[75051]:   </cpu>
Nov 24 18:52:51 user nova-compute[75051]:   <devices>
Nov 24 18:52:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk"/>
Nov 24 18:52:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:     </disk>
Nov 24 18:52:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:51 user nova-compute[75051]:       <mac address="fa:16:3e:70:1e:f0"/>
Nov 24 18:52:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:51 user nova-compute[75051]:       <target dev="tapd7abb801-e4"/>
Nov 24 18:52:51 user nova-compute[75051]:     </interface>
Nov 24 18:52:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/console.log" append="off"/>
Nov 24 18:52:51 user nova-compute[75051]:     </serial>
Nov 24 18:52:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:51 user nova-compute[75051]:     <video>
Nov 24 18:52:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:51 user nova-compute[75051]:     </video>
Nov 24 18:52:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:51 user nova-compute[75051]:     </rng>
Nov 24 18:52:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:51 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:51 user nova-compute[75051]:   </devices>
Nov 24 18:52:51 user nova-compute[75051]: </domain>
Nov 24 18:52:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780787285',display_name='tempest-TestVolumeSwap-server-1780787285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780787285',id=6,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuc3dXEODIsjD1N+lB4qnDxsB96ThbmvHGUw/haqk1ovJMKxSredwzkFEVGQnJNpseVXW1drhrFZ7CwmrilhB4FghiTQJQVjaecDESNpcw78xvkoAs1alAbkY9eRtlJqw==',key_name='tempest-keypair-1587869462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54c56b6e4e2747a79682208777045231',ramdisk_id='',reservation_id='r-plzo3x3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1784958988',owner_user_name='tempest-TestVolumeSwap-1784958988-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14001a6e46b9400b83132cdcca29e31f',uuid=f0410591-5d5c-473a-93a9-283730abc348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converting VIF {"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG os_vif [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4411696e-4a14-59cb-bc43-368216e3d31c', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:51 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Creating config drive at /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq33n0rlx {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updating instance_info_cache with network_info: [{"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7abb801-e4, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7abb801-e4, col_values=(('qos', UUID('7dffc9ae-bc82-44fd-bee2-a29a86303b16')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7abb801-e4, col_values=(('external_ids', {'iface-id': 'd7abb801-e462-4749-8349-13f953f5d61b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:1e:f0', 'vm-uuid': 'f0410591-5d5c-473a-93a9-283730abc348'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq33n0rlx" returned: 0 in 0.072s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Releasing lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Instance network_info: |[{"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Start _get_guest_xml network_info=[{"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:52:38Z,direct_url=<?>,disk_format='qcow2',id=e8ea8490-0a56-4692-bcd3-bf4396265d41,min_disk=0,min_ram=0,name='',owner='0502051da5834aaa83422406cd74537b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:52:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'e8ea8490-0a56-4692-bcd3-bf4396265d41'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: INFO os_vif [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4')
Nov 24 18:52:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:52:38Z,direct_url=<?>,disk_format='qcow2',id=e8ea8490-0a56-4692-bcd3-bf4396265d41,min_disk=0,min_ram=0,name='',owner='0502051da5834aaa83422406cd74537b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:52:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-286853329',display_name='tempest-AttachSCSIVolumeTestJSON-server-286853329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-286853329',id=7,image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEr9OaqyNecGuqJiGaOVs7+DnMMboPelFq37h0hVdUzV+tFmLN2SjTXxQIDPJPIrwyPWX+8fILR1e6cdCrk7N3gG9MXrhAOW3NTqY74Nr1TKZZTt+gwqTvNDuiLQkT7Uw==',key_name='tempest-keypair-183800523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86489e5f33d24e35bff96a224cc4c778',ramdisk_id='',reservation_id='r-o6y7q6s7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1592601763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1592601763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfb56e8f1ba48fc9a5d2d454a9d71c4',uuid=b9dd0e67-88e8-4b07-98ba-04fb21fa87f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converting VIF {"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lazy-loading 'pci_devices' on Instance uuid b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:52:52 user nova-compute[75051]:   <uuid>b9dd0e67-88e8-4b07-98ba-04fb21fa87f5</uuid>
Nov 24 18:52:52 user nova-compute[75051]:   <name>instance-00000007</name>
Nov 24 18:52:52 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:52:52 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:52:52 user nova-compute[75051]:   <metadata>
Nov 24 18:52:52 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:52:52 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-286853329</nova:name>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:52:52</nova:creationTime>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:52:52 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:52:52 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:owner>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:user uuid="ecfb56e8f1ba48fc9a5d2d454a9d71c4">tempest-AttachSCSIVolumeTestJSON-1592601763-project-member</nova:user>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:project uuid="86489e5f33d24e35bff96a224cc4c778">tempest-AttachSCSIVolumeTestJSON-1592601763</nova:project>
Nov 24 18:52:52 user nova-compute[75051]:       </nova:owner>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:root type="image" uuid="e8ea8490-0a56-4692-bcd3-bf4396265d41"/>
Nov 24 18:52:52 user nova-compute[75051]:       <nova:ports>
Nov 24 18:52:52 user nova-compute[75051]:         <nova:port uuid="023e6dbb-607c-4da2-a30a-757bd15faca9">
Nov 24 18:52:52 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 18:52:52 user nova-compute[75051]:         </nova:port>
Nov 24 18:52:52 user nova-compute[75051]:       </nova:ports>
Nov 24 18:52:52 user nova-compute[75051]:     </nova:instance>
Nov 24 18:52:52 user nova-compute[75051]:   </metadata>
Nov 24 18:52:52 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:52:52 user nova-compute[75051]:     <system>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="serial">b9dd0e67-88e8-4b07-98ba-04fb21fa87f5</entry>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="uuid">b9dd0e67-88e8-4b07-98ba-04fb21fa87f5</entry>
Nov 24 18:52:52 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:52:52 user nova-compute[75051]:     </system>
Nov 24 18:52:52 user nova-compute[75051]:   </sysinfo>
Nov 24 18:52:52 user nova-compute[75051]:   <os>
Nov 24 18:52:52 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:52:52 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:52:52 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:52:52 user nova-compute[75051]:   </os>
Nov 24 18:52:52 user nova-compute[75051]:   <features>
Nov 24 18:52:52 user nova-compute[75051]:     <acpi/>
Nov 24 18:52:52 user nova-compute[75051]:     <apic/>
Nov 24 18:52:52 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:52:52 user nova-compute[75051]:   </features>
Nov 24 18:52:52 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:52:52 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:52:52 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:52:52 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:52:52 user nova-compute[75051]:   </clock>
Nov 24 18:52:52 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:52:52 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:52:52 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:52:52 user nova-compute[75051]:   </cpu>
Nov 24 18:52:52 user nova-compute[75051]:   <devices>
Nov 24 18:52:52 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:52:52 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:52:52 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk"/>
Nov 24 18:52:52 user nova-compute[75051]:       <target dev="sda" bus="scsi"/>
Nov 24 18:52:52 user nova-compute[75051]:       <address type="drive" controller="0" unit="0"/>
Nov 24 18:52:52 user nova-compute[75051]:     </disk>
Nov 24 18:52:52 user nova-compute[75051]:     <disk type="file" device="cdrom">
Nov 24 18:52:52 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 18:52:52 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.config"/>
Nov 24 18:52:52 user nova-compute[75051]:       <target dev="sdb" bus="scsi"/>
Nov 24 18:52:52 user nova-compute[75051]:       <address type="drive" controller="0" unit="1"/>
Nov 24 18:52:52 user nova-compute[75051]:     </disk>
Nov 24 18:52:52 user nova-compute[75051]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 24 18:52:52 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:52:52 user nova-compute[75051]:       <mac address="fa:16:3e:84:c5:ff"/>
Nov 24 18:52:52 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:52 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:52:52 user nova-compute[75051]:       <target dev="tap023e6dbb-60"/>
Nov 24 18:52:52 user nova-compute[75051]:     </interface>
Nov 24 18:52:52 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:52:52 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/console.log" append="off"/>
Nov 24 18:52:52 user nova-compute[75051]:     </serial>
Nov 24 18:52:52 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:52:52 user nova-compute[75051]:     <video>
Nov 24 18:52:52 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:52:52 user nova-compute[75051]:     </video>
Nov 24 18:52:52 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:52:52 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:52:52 user nova-compute[75051]:     </rng>
Nov 24 18:52:52 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:52:52 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:52:52 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:52:52 user nova-compute[75051]:     </memballoon>
Nov 24 18:52:52 user nova-compute[75051]:   </devices>
Nov 24 18:52:52 user nova-compute[75051]: </domain>
Nov 24 18:52:52 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-286853329',display_name='tempest-AttachSCSIVolumeTestJSON-server-286853329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-286853329',id=7,image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEr9OaqyNecGuqJiGaOVs7+DnMMboPelFq37h0hVdUzV+tFmLN2SjTXxQIDPJPIrwyPWX+8fILR1e6cdCrk7N3gG9MXrhAOW3NTqY74Nr1TKZZTt+gwqTvNDuiLQkT7Uw==',key_name='tempest-keypair-183800523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86489e5f33d24e35bff96a224cc4c778',ramdisk_id='',reservation_id='r-o6y7q6s7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1592601763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1592601763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfb56e8f1ba48fc9a5d2d454a9d71c4',uuid=b9dd0e67-88e8-4b07-98ba-04fb21fa87f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converting VIF {"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG os_vif [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22c9d847-b025-516b-b381-9850f08d578f', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] No VIF found with MAC fa:16:3e:70:1e:f0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap023e6dbb-60, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap023e6dbb-60, col_values=(('qos', UUID('d42ad600-5cfb-4524-b98b-7f707f511a9c')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap023e6dbb-60, col_values=(('external_ids', {'iface-id': '023e6dbb-607c-4da2-a30a-757bd15faca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:c5:ff', 'vm-uuid': 'b9dd0e67-88e8-4b07-98ba-04fb21fa87f5'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-changed-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Refreshing instance network info cache due to event network-changed-023e6dbb-607c-4da2-a30a-757bd15faca9. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] Acquiring lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] Acquired lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Refreshing network info cache for port 023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:52 user nova-compute[75051]: INFO os_vif [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60')
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No BDM found with device name sda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No VIF found with MAC fa:16:3e:84:c5:ff, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:52:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Using config drive
Nov 24 18:52:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Creating config drive at /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.config
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp85pv9caw {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp85pv9caw" returned: 0 in 0.065s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-changed-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing instance network info cache due to event network-changed-100a87c1-4a68-4946-a293-96ace9269687. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing network info cache for port 100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.network.neutron [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updated VIF entry in instance network info cache for port 023e6dbb-607c-4da2-a30a-757bd15faca9. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.network.neutron [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updating instance_info_cache with network_info: [{"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f347590f-cffb-44c9-a2ce-009e24547722 req-bc4e7b53-0207-4145-94dd-06d70d42eaee service nova] Releasing lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:52:53 user nova-compute[75051]: INFO nova.compute.claims [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Claim successful on node user
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.network.neutron [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updated VIF entry in instance network info cache for port 100a87c1-4a68-4946-a293-96ace9269687. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG nova.network.neutron [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8cb81f05-8d86-4198-9b90-54759dc2e105 req-b340666b-c447-4121-8e5c-e337478f5380 service nova] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:52:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:52:54 user nova-compute[75051]: DEBUG nova.policy [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c302b95e8c240f78684448f37d317e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc9f240a45c840cb9715c2c608250d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:52:54 user nova-compute[75051]: INFO nova.virt.block_device [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Booting with volume c846ce81-0890-47e5-bd84-76f6b1817724 at /dev/vda
Nov 24 18:52:54 user nova-compute[75051]: DEBUG os_brick.utils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:52:54 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp387aylz_/privsep.sock']
Nov 24 18:52:54 user sudo[85365]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp387aylz_/privsep.sock
Nov 24 18:52:54 user sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 24 18:52:55 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Successfully created port: cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:52:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:56 user nova-compute[75051]: WARNING nova.compute.manager [req-70c48e92-d763-4175-9ab3-741da00fa231 req-8080c563-77c2-4870-bb8c-aeec2763239f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 for instance with vm_state building and task_state spawning.
Nov 24 18:52:56 user sudo[85365]: pam_unix(sudo:session): session closed for user root
Nov 24 18:52:56 user nova-compute[75051]: INFO oslo.privsep.daemon [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Spawned new privsep daemon via rootwrap
Nov 24 18:52:56 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 24 18:52:56 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 24 18:52:56 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 24 18:52:56 user nova-compute[75051]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85538
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece0ab2e-6ca4-487f-a0f3-ea7ab830c7b4]: (2,) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Successfully updated port: cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquired lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83b34c2-4332-4bcd-95a4-7f9d9532d007]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:57 user nova-compute[75051]: WARNING os_brick.initiator.connectors.nvmeof [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52272b-1340-40eb-b517-f9229db652fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37948d00-48de-4e62-b91c-686138ef5508]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d84f635-46ca-4645-85f4-7db887eaa30f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:52:57 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc4b4bb-8883-4215-8f69-197c1c79216a]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG os_brick.utils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== get_connector_properties: return (2559ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating existing volume attachment record: a8202023-7c64-43af-9818-64eb0b2f363d {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating instance_info_cache with network_info: [{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Releasing lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance network_info: |[{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-changed-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Refreshing instance network info cache due to event network-changed-cfff62d2-06f1-41c6-9394-7a02c1f328dc. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Acquiring lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Acquired lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG nova.network.neutron [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Refreshing network info cache for port cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG nova.network.neutron [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updated VIF entry in instance network info cache for port cfff62d2-06f1-41c6-9394-7a02c1f328dc. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG nova.network.neutron [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating instance_info_cache with network_info: [{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Releasing lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:52:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:52:59 user nova-compute[75051]: WARNING nova.compute.manager [req-45760e98-fc77-412b-8622-ba0e687720f7 req-4f9a15c5-b829-4859-8fae-f20c26ed7b0f service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 for instance with vm_state building and task_state spawning.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Instance spawned successfully.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Instance spawned successfully.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance spawned successfully.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Took 10.31 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Took 11.77 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Took 12.96 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Took 12.94 seconds to build instance.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-61c065ad-8da8-43d1-87e1-e2916f78f30d tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.115s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Took 14.16 seconds to build instance.
Nov 24 18:53:00 user nova-compute[75051]: INFO nova.compute.manager [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Took 13.32 seconds to build instance.
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47eb93b9-b82f-497b-a44a-57ef5bea4e4e tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.452s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3f9a1c2a-e7f0-4d9f-9db0-42692162561b tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.398s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 18:53:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:05 user nova-compute[75051]: WARNING nova.compute.manager [req-717e247e-878f-45eb-8e0c-7cf4afcf15d7 req-506dab44-75cb-45db-825a-e1092322e229 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state None.
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] No waiting events found dispatching network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:05 user nova-compute[75051]: WARNING nova.compute.manager [req-538d2384-4d23-4def-9001-86d191d0311c req-2f35d0da-cbdd-40ae-847c-5bb15fb60d88 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received unexpected event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b for instance with vm_state active and task_state None.
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:07 user nova-compute[75051]: WARNING nova.compute.manager [req-99255afd-4fc5-48e6-b02c-1cec137da9df req-9397bdfd-902f-4004-81ef-cfbb5c8a68d8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state None.
Nov 24 18:53:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:53:07 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Creating image(s)
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Ensure instance console log exists: /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start _get_guest_xml network_info=[{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bec46576-e2b6-4bc9-8648-5cc341ac2144', 'attached_at': '', 'detached_at': '', 'volume_id': 'c846ce81-0890-47e5-bd84-76f6b1817724', 'serial': 'c846ce81-0890-47e5-bd84-76f6b1817724'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a8202023-7c64-43af-9818-64eb0b2f363d', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:53:07 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:07 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connector [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Factory for ISCSI on None {{(pid=75051) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.010s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:07 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:07 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:07 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb52dbb-3fc1-4eda-9f12-919ebb6a1038]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:07 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88abe7-8cce-4e3d-bd70-1bccdeae7c07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724] added
Nov 24 18:53:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4cf07a-7e56-433e-ae61-9f24253aab63]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11d129-cb5a-408d-b691-5cfa1fe0c65c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDcxQVvm {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDcxQVvm" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e62e66b-8a6d-4996-92ad-1992524a27b5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDcxQVvm'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c099f182-1be3-4119-9e8f-c4d033ce9cc9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f6f24-fc94-4675-90bf-c1c27b7a17ac]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 18:53:07 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 18:53:07 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:07 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 18:53:07 user nova-compute[75051]: 
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0f3b6-b114-44b8-ad5d-802620c974c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]
Nov 24 18:53:07 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cb9e52-2865-4818-a9df-959277bd0819]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] No waiting events found dispatching network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:08 user nova-compute[75051]: WARNING nova.compute.manager [req-fc2b7b93-a8b3-4256-926d-a1e853425c47 req-18b1c5f5-767b-4492-9aff-bd2a561e0dd1 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received unexpected event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b for instance with vm_state active and task_state None.
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7852MB free_disk=25.769561767578125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9a6a6-c274-4047-9dbf-09056541f9bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8af5c7-1749-45db-9a9d-5397baf9ceb0]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fe0ec57a-6937-4277-a62f-22aa0622d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f0410591-5d5c-473a-93a9-283730abc348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bec46576-e2b6-4bc9-8648-5cc341ac2144 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:53:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.768s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '23531363531633738', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531363531633738', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-240118934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lazy-loading 'pci_devices' on Instance uuid bec46576-e2b6-4bc9-8648-5cc341ac2144 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:53:09 user nova-compute[75051]:   <uuid>bec46576-e2b6-4bc9-8648-5cc341ac2144</uuid>
Nov 24 18:53:09 user nova-compute[75051]:   <name>instance-00000009</name>
Nov 24 18:53:09 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:53:09 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:53:09 user nova-compute[75051]:   <metadata>
Nov 24 18:53:09 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:53:09 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:53:09 user nova-compute[75051]:       <nova:name>tempest-ServerActionsV293TestJSON-server-240118934</nova:name>
Nov 24 18:53:09 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:53:07</nova:creationTime>
Nov 24 18:53:09 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:53:09 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:53:09 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:53:09 user nova-compute[75051]:       <nova:owner>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:user uuid="7c302b95e8c240f78684448f37d317e2">tempest-ServerActionsV293TestJSON-114400367-project-member</nova:user>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:project uuid="cc9f240a45c840cb9715c2c608250d9f">tempest-ServerActionsV293TestJSON-114400367</nova:project>
Nov 24 18:53:09 user nova-compute[75051]:       </nova:owner>
Nov 24 18:53:09 user nova-compute[75051]:       <nova:ports>
Nov 24 18:53:09 user nova-compute[75051]:         <nova:port uuid="cfff62d2-06f1-41c6-9394-7a02c1f328dc">
Nov 24 18:53:09 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 18:53:09 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:09 user nova-compute[75051]:       </nova:ports>
Nov 24 18:53:09 user nova-compute[75051]:     </nova:instance>
Nov 24 18:53:09 user nova-compute[75051]:   </metadata>
Nov 24 18:53:09 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:53:09 user nova-compute[75051]:     <system>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="serial">bec46576-e2b6-4bc9-8648-5cc341ac2144</entry>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="uuid">bec46576-e2b6-4bc9-8648-5cc341ac2144</entry>
Nov 24 18:53:09 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:53:09 user nova-compute[75051]:     </system>
Nov 24 18:53:09 user nova-compute[75051]:   </sysinfo>
Nov 24 18:53:09 user nova-compute[75051]:   <os>
Nov 24 18:53:09 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:53:09 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:53:09 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:53:09 user nova-compute[75051]:   </os>
Nov 24 18:53:09 user nova-compute[75051]:   <features>
Nov 24 18:53:09 user nova-compute[75051]:     <acpi/>
Nov 24 18:53:09 user nova-compute[75051]:     <apic/>
Nov 24 18:53:09 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:53:09 user nova-compute[75051]:   </features>
Nov 24 18:53:09 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:53:09 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:53:09 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:53:09 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:53:09 user nova-compute[75051]:   </clock>
Nov 24 18:53:09 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:53:09 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:53:09 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:53:09 user nova-compute[75051]:   </cpu>
Nov 24 18:53:09 user nova-compute[75051]:   <devices>
Nov 24 18:53:09 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:09 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:09 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 18:53:09 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:53:09 user nova-compute[75051]:       <serial>c846ce81-0890-47e5-bd84-76f6b1817724</serial>
Nov 24 18:53:09 user nova-compute[75051]:     </disk>
Nov 24 18:53:09 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:09 user nova-compute[75051]:       <mac address="fa:16:3e:6b:7c:d2"/>
Nov 24 18:53:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:09 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:09 user nova-compute[75051]:       <target dev="tapcfff62d2-06"/>
Nov 24 18:53:09 user nova-compute[75051]:     </interface>
Nov 24 18:53:09 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:53:09 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144/console.log" append="off"/>
Nov 24 18:53:09 user nova-compute[75051]:     </serial>
Nov 24 18:53:09 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:53:09 user nova-compute[75051]:     <video>
Nov 24 18:53:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:09 user nova-compute[75051]:     </video>
Nov 24 18:53:09 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:53:09 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:53:09 user nova-compute[75051]:     </rng>
Nov 24 18:53:09 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:53:09 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:53:09 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:53:09 user nova-compute[75051]:     </memballoon>
Nov 24 18:53:09 user nova-compute[75051]:   </devices>
Nov 24 18:53:09 user nova-compute[75051]: </domain>
Nov 24 18:53:09 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-240118934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG os_vif [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '382431a4-d32c-5a34-9eb3-f4f80b84cc1e', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfff62d2-06, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfff62d2-06, col_values=(('qos', UUID('bd131fd5-3ebf-4987-8d17-af8901236839')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfff62d2-06, col_values=(('external_ids', {'iface-id': 'cfff62d2-06f1-41c6-9394-7a02c1f328dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7c:d2', 'vm-uuid': 'bec46576-e2b6-4bc9-8648-5cc341ac2144'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:09 user nova-compute[75051]: INFO os_vif [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06')
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:53:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] No VIF found with MAC fa:16:3e:6b:7c:d2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Skipping network cache update for instance because it is Building. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:53:10 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid fe0ec57a-6937-4277-a62f-22aa0622d06e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating instance_info_cache with network_info: [{"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-fe0ec57a-6937-4277-a62f-22aa0622d06e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:11 user nova-compute[75051]: WARNING nova.compute.manager [req-11243d92-7087-4809-bf90-a2b9bb34541e req-6718b7b3-e156-457d-b7a0-318fc288a19b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state None.
Nov 24 18:53:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:12 user nova-compute[75051]: WARNING nova.compute.manager [req-d3193ef4-bfa4-4696-a28b-92a68b33dc30 req-1a4a93ca-b6bc-4545-9094-d4a42ce4d62f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state building and task_state spawning.
Nov 24 18:53:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:13 user nova-compute[75051]: WARNING nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state None.
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] No waiting events found dispatching network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:13 user nova-compute[75051]: WARNING nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received unexpected event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 for instance with vm_state active and task_state None.
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] No waiting events found dispatching network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:13 user nova-compute[75051]: WARNING nova.compute.manager [req-0d628230-a740-4fea-b200-157aae4f6ff2 req-51bf17a4-4612-4316-8adf-edb068262fc7 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received unexpected event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 for instance with vm_state active and task_state None.
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:14 user nova-compute[75051]: WARNING nova.compute.manager [req-2d4d238e-3024-4374-9acc-046acf142f33 req-c4402389-d08e-41eb-b2e6-5dd387b1a83c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state building and task_state spawning.
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:14 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance spawned successfully.
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:14 user nova-compute[75051]: INFO nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Took 7.12 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:14 user nova-compute[75051]: INFO nova.compute.manager [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Took 21.03 seconds to build instance.
Nov 24 18:53:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8ae1f14d-418e-461b-86c6-8ec48b9a41a4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:17 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:53:17 user nova-compute[75051]: INFO nova.compute.claims [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Claim successful on node user
Nov 24 18:53:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.744s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.676s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:53:18 user nova-compute[75051]: INFO nova.compute.claims [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Claim successful on node user
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:53:18 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:53:18 user nova-compute[75051]: INFO nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Booting with volume cdc277a3-1626-4f22-962f-9e0ebe78b07b at /dev/vda
Nov 24 18:53:18 user nova-compute[75051]: DEBUG nova.policy [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f61bed5ee29e4282acf077e10b140e97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dea95244ac640c59516fbcda9f1e028', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca059011-ee1d-40fb-a39a-2adeaba823ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b38265-ada6-4603-8b6d-871feb745bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.110s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d0a61-5942-48bd-9459-476ecd78805b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3924b8-3f7a-40f6-85ba-190ad76384c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:19 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e586d7c-3ada-4a12-85cb-4724560dea36]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== get_connector_properties: return (254ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating existing volume attachment record: c0cb6b71-e2f7-4de1-ad0e-482ff9d02a8a {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:53:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:53:19 user nova-compute[75051]: INFO nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Booting with volume 780459b0-ad74-4a6d-88e9-42bef53d3a11 at /dev/vda
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.policy [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92c75efaae44fc0a39baef226105b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f37c20b6ddd74260b6b62417476cdc7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eae1f2-77fa-4732-ada9-777a1a8517da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf48100a-1ba7-455c-8f76-faecdfe5a44d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b2ce6e-e091-47cf-aabe-647039bfedb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9968113-d8ac-4493-8217-296d714b4dfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:19 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac22e432-24f4-41f0-a9eb-c182866da59d]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating existing volume attachment record: 172f3d2d-4fc3-438b-ba5e-379cbb3a0747 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:19 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully created port: a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:20 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully created port: 23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:20 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully created port: f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully created port: 86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully created port: ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully created port: 6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully created port: 8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully created port: 53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully created port: a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-a5a438c0-7817-4d84-b3a9-c91f51a1d36c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully created port: 5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ce026c-c0e2-4f43-a789-5ce1bd46218b req-1ca8b4f4-f7e5-473e-a422-6b8cc1ee1a00 service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-f8031932-a2e0-4d12-9f38-04273d53b85a. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: 1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-052e16e5-0ed9-48e4-af4e-18c9781cd05c req-b96bbb99-462e-43c3-b22e-5df6d675b52d service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: 23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-ba629722-f270-40f0-920c-0bf684e25d75. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-1338870f-d540-4072-aa99-240541f1ccdc. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port 1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: 86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port 23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-b1010f31-a7d7-4156-9113-a02ab3de36df. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f7994bae-38cc-4013-9688-872fb0d1ce0a req-e94bdda3-3c4d-4ef4-8246-1d1e08e6c432 service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d01b27dd-ece4-462e-a6a2-8db64f716335 req-dc198adb-71a3-4f21-8635-f87b40ab0a8e service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: 6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:26 user nova-compute[75051]: INFO nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Booting with volume aa82bb68-7f8b-45cb-a519-935bbee42636 at /dev/vdb
Nov 24 18:53:26 user nova-compute[75051]: INFO nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Booting with volume 0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 at /dev/vdb
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: 1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa0a01-ab76-457a-95e3-4dc05d4b0a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[551273a2-4ef4-4b8c-a1d9-320fdfda31f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a093aa29-1080-4a6c-a63b-31fefef5f20d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f32b02-1d79-4350-80ba-3b2156d4cf12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd145e-3632-4e2c-b353-d75ee454baaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c0761-8374-4ae4-b039-d2c7ae5e63ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f6ea0-24a2-4efb-9d28-bf8dc1da9b59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0653de6a-4bf8-428d-8cfa-6e75aadd784d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:26 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37cd7a4-8a20-4535-ba14-92ef08c23dba]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating existing volume attachment record: f7303c0b-e3ad-4ad7-a93d-24b5278d92b9 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:26 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b73c7-41b3-4df6-8df7-10c2baa7ccd1]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:26 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating existing volume attachment record: f4725217-3dcd-4d30-83c4-20e9b0a3a213 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-86285a16-45ce-4fee-9115-d196637cccf3. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port 86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-6a7b4267-a8c3-4237-ad90-884dee0e889c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port 6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Successfully updated port: 53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a3edd69-039a-407b-a7a0-04cfbd6e76d1 req-dc8c74d2-a3bb-4ec8-8730-c4515b1c20f2 service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:53:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: 8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-1482f34a-9d12-434c-9eb9-cef34a221e9d. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port 1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-53ad060d-cc1f-4417-9732-27af3a1b8589. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:28 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Successfully updated port: 5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-8c8e5ee6-9b37-4c3d-8102-07d3e354d574. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port 8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-23deaebc-f93b-45ba-bc08-d775405db753 req-4e551eec-7b99-49e0-9ffa-dc5961d62d09 service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance network_info: |[{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port 53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-5aa616a3-c72a-46a9-874e-ea0ba316edfa. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updated VIF entry in instance network info cache for port 53ad060d-cc1f-4417-9732-27af3a1b8589. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb2d809-f99a-4ccb-a747-aa038cb6fcea req-1cb3b917-d388-47f6-bd21-ea83bda3311e service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance network_info: |[{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:53:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:53:33 user nova-compute[75051]: DEBUG nova.network.neutron [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port 5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG nova.network.neutron [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updated VIF entry in instance network info cache for port 5aa616a3-c72a-46a9-874e-ea0ba316edfa. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG nova.network.neutron [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a2cc0fd7-d80d-46a9-8f79-9f7d9dc2780d req-bcf6d77f-1ed3-4b49-a316-e2b2991c4163 service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:53:34 user nova-compute[75051]: INFO nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Booting with volume 70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 at /dev/vdc
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0c42a-451f-4820-b459-e4c8fe0f498c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35dab4-d1c4-40d0-b6fe-39877da0e539]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e29ed6-3969-44be-b65f-19b2e20668a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3208b36-86e7-407e-bb32-88de127296f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:34 user nova-compute[75051]: INFO nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Booting with volume 1c4e566d-4616-4018-bc66-37e9a42fbc5a at /dev/vdc
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:34 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d35b35f-ca3b-4fd2-b459-d0ec75148237]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.utils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating existing volume attachment record: abb5223c-bdf6-493c-bf89-c077cfe876af {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28fba9-bb85-428d-bfbe-2fb1ae6638f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d554fc31-13a3-4c85-8a56-1d77f17145df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa41667-e58f-4316-b8ac-351dfe3cab0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b16353c-58d9-4eaf-aa45-521388a27ed1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:53:34 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:53:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b48091-b0fe-4326-b472-3a85497deb19]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG os_brick.utils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating existing volume attachment record: d97d94ce-438f-42af-b642-ed0a38244df7 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:53:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:53:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Creating image(s)
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Ensure instance console log exists: /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Start _get_guest_xml network_info=[{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUakvwXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686', 'attached_at': '', 'detached_at': '', 'volume_id': '780459b0-ad74-4a6d-88e9-42bef53d3a11', 'serial': '780459b0-ad74-4a6d-88e9-42bef53d3a11'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '172f3d2d-4fc3-438b-ba5e-379cbb3a0747', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgDbjsni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686', 'attached_at': '', 'detached_at': '', 'volume_id': 'aa82bb68-7f8b-45cb-a519-935bbee42636', 'serial': 'aa82bb68-7f8b-45cb-a519-935bbee42636'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'f7303c0b-e3ad-4ad7-a93d-24b5278d92b9', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIpfcxiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686', 'attached_at': '', 'detached_at': '', 'volume_id': '70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 'serial': '70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'abb5223c-bdf6-493c-bf89-c077cfe876af', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:53:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUakvwXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:41 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:41 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:41 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764a95f-ab75-42fa-aa03-6faae98fe6f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:41 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b74e43-2d97-4cc2-8620-38f3c7892208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11] added
Nov 24 18:53:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f865cdd-bc47-4ee2-a774-dfc380028224]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2849933-e530-40e5-a8a9-1fb05ff8cbbb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUakvwXO {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUakvwXO" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[293f1c79-9e5c-4a5e-bb6c-d49ce12c9b0c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUakvwXO'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b578e-566c-4825-a8f5-8f05331e78c8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6980dd41-3c43-418f-beab-111afc3e81e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --login" returned: 0 in 1.076s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ee29b-3989-4573-bcb1-05311e92275c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260]
Nov 24 18:53:42 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb41f2a4-f6f4-41f3-8c4a-054a1dcad9fd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8dcf6-bf91-4c2b-b81c-96cf0832ed99]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:42 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:42 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.293s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b2dbb-9be8-4b85-8611-be5e1c3575a5]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUakvwXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:53:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Creating image(s)
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Ensure instance console log exists: /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Start _get_guest_xml network_info=[{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpmrshjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a95e25-c59c-46f7-9aeb-d3f01146c189', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdc277a3-1626-4f22-962f-9e0ebe78b07b', 'serial': 'cdc277a3-1626-4f22-962f-9e0ebe78b07b'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c0cb6b71-e2f7-4de1-ad0e-482ff9d02a8a', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYhTcJis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a95e25-c59c-46f7-9aeb-d3f01146c189', 'attached_at': '', 'detached_at': '', 'volume_id': '0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 'serial': '0e6ec4e5-b335-495e-adf3-d1cdbd9944c7'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'f4725217-3dcd-4d30-83c4-20e9b0a3a213', 'boot_index': 1, 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPyFTihg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00a95e25-c59c-46f7-9aeb-d3f01146c189', 'attached_at': '', 'detached_at': '', 'volume_id': '1c4e566d-4616-4018-bc66-37e9a42fbc5a', 'serial': '1c4e566d-4616-4018-bc66-37e9a42fbc5a'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'd97d94ce-438f-42af-b642-ed0a38244df7', 'boot_index': 2, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:53:42 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:42 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpmrshjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:42 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.325s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== connect_volume: return (2327ms) {'type': 'block', 'scsi_wwn': '26637393463343266', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637393463343266', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.917s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:43 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff6e11-167b-4662-8524-a7c929d5663d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:43 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgDbjsni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138384d-6639-422f-9a9c-7a75c6c40340]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b] added
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f2ae8-6785-4432-bcf7-30ebc56dd455]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d76635-26bf-4c4b-962b-08c3c51b9b88]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpmrshjT {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QpmrshjT" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb7fb8-9098-4571-9dd4-bd35d060266b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QpmrshjT'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc10aab4-c79c-4fa4-a353-c8c94193891c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cca0b73-50e2-4dba-9aaa-6f5cf46a02bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9722be1a-3cc2-4bc7-a74b-8cce5785efec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260]
Nov 24 18:53:43 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f40a4-bd40-4775-b634-32d54e603e19]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37f78c7-d38c-4a08-b4b3-f751fb5b111a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:43 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78d9966-e5bc-4ee0-9a2e-339c38b57367]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpmrshjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== connect_volume: return (2227ms) {'type': 'block', 'scsi_wwn': '23465646638633336', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465646638633336', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.277s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:44 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd44572c-f061-457e-8c7f-c1e64d3466d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:44 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYhTcJis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb17b22-bb66-4af6-9553-835825da093e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636] added
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[003cafdc-e992-446e-947e-10acc8e121bf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[851f50e4-117f-43f3-92e6-128ea60fdb26]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgDbjsni {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgDbjsni" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d5c23-9bba-440d-ad9e-e54f91d927bf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgDbjsni'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19bd1f2-060b-418d-b508-3ac043e8cbbf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c95a5-d344-4b59-a4d7-612e67dfb864]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b48f84-9636-41fc-a35a-f62d27574e06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260]
Nov 24 18:53:44 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3212f514-2c7d-4275-9add-14db0b1fc2b5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da217e8-726c-435f-9377-f3f6a1b2716f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:44 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a317089-fa56-4067-ae6d-70ae90da50c7]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgDbjsni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== connect_volume: return (2607ms) {'type': 'block', 'scsi_wwn': '23437383537363330', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437383537363330', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.297s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:45 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7ca9be-403b-4c03-90b7-b5adf38004f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:45 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIpfcxiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:46 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2553f3-bea3-4cfb-8eed-2ceae90c8265]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7] added
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa63b9-5855-4531-8a52-e985135fd8ae]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce019520-13c5-4b31-b349-d7896f1bfeaa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYhTcJis {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYhTcJis" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb201f-0bb4-43b1-a639-a13a0788eeac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYhTcJis'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[826df4b0-eef1-4280-8bce-5cf96482d4cb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a26b8d-ab97-4a32-84b4-e452c384942b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ceee03-e1b6-4423-9722-2f2ab3b22a02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260]
Nov 24 18:53:46 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.080s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06165ee4-0272-4ef7-9536-70e66f9fdfa9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3f59e5-9c5f-4927-986c-ea176667c4db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845c952-fa4f-45f0-9485-7139e2976e2d]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYhTcJis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== connect_volume: return (2690ms) {'type': 'block', 'scsi_wwn': '23135326236326432', 'path': '/dev/sdf'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135326236326432', 'path': '/dev/sdf'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.364s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:47 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:47 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c745108-5ebc-470c-b836-f1fe53346a04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:47 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPyFTihg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:53:47 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50104103-cc74-45ab-99a0-6567d3fc6297]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8] added
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4842f-d88e-4f20-9c16-15a89bf7fd7d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5974ab7-0f8a-4a2a-85db-c4911dc85f37]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIpfcxiq {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZIpfcxiq" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d1452-775a-4207-b878-27ea9abec769]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZIpfcxiq'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f3bd9-78cc-48d9-bd28-210436b3d0fe]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc20eea-12a5-4659-9dc9-dd766e9728c2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57eef8d-bed4-4fbe-917a-0aca6ce90237]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260]
Nov 24 18:53:47 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95681e1e-cd93-421d-9df9-07c21b7dd43c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ae3f77-4be8-4585-80b7-00f21a7ec24c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d713108-ab8e-4ca8-a330-93fe8897d7a2]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIpfcxiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== connect_volume: return (2698ms) {'type': 'block', 'scsi_wwn': '26332653334316332', 'path': '/dev/sdg'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653334316332', 'path': '/dev/sdg'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.302s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:48 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:53:48 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[59404427-23eb-4ff1-bfcd-c99538f90682]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:53:48 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lazy-loading 'pci_devices' on Instance uuid e1ff9da6-e31d-49f6-a48f-56a2c4866686 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb57c99-9e10-4bd9-b9aa-d31ec3f8023a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a] added
Nov 24 18:53:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:53:48 user nova-compute[75051]:   <uuid>e1ff9da6-e31d-49f6-a48f-56a2c4866686</uuid>
Nov 24 18:53:48 user nova-compute[75051]:   <name>instance-0000000b</name>
Nov 24 18:53:48 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:53:48 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:53:48 user nova-compute[75051]:   <metadata>
Nov 24 18:53:48 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:53:48 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:name>tempest-device-tagging-server-1093516138</nova:name>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:53:40</nova:creationTime>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:53:48 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:53:48 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:owner>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:user uuid="b92c75efaae44fc0a39baef226105b86">tempest-TaggedBootDevicesTest_v242-300268766-project-member</nova:user>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:project uuid="f37c20b6ddd74260b6b62417476cdc7d">tempest-TaggedBootDevicesTest_v242-300268766</nova:project>
Nov 24 18:53:48 user nova-compute[75051]:       </nova:owner>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:53:48 user nova-compute[75051]:       <nova:ports>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="f8031932-a2e0-4d12-9f38-04273d53b85a">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="b1010f31-a7d7-4156-9113-a02ab3de36df">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="1482f34a-9d12-434c-9eb9-cef34a221e9d">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="ea999b70-6d0b-4d3c-a7d7-b627ca5bd920">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="8c8e5ee6-9b37-4c3d-8102-07d3e354d574">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="a9d6ec78-0eee-4f7f-bdeb-7232556cc90a">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:         <nova:port uuid="5aa616a3-c72a-46a9-874e-ea0ba316edfa">
Nov 24 18:53:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 24 18:53:48 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:48 user nova-compute[75051]:       </nova:ports>
Nov 24 18:53:48 user nova-compute[75051]:     </nova:instance>
Nov 24 18:53:48 user nova-compute[75051]:   </metadata>
Nov 24 18:53:48 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:53:48 user nova-compute[75051]:     <system>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="serial">e1ff9da6-e31d-49f6-a48f-56a2c4866686</entry>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="uuid">e1ff9da6-e31d-49f6-a48f-56a2c4866686</entry>
Nov 24 18:53:48 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:53:48 user nova-compute[75051]:     </system>
Nov 24 18:53:48 user nova-compute[75051]:   </sysinfo>
Nov 24 18:53:48 user nova-compute[75051]:   <os>
Nov 24 18:53:48 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:53:48 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:53:48 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:53:48 user nova-compute[75051]:   </os>
Nov 24 18:53:48 user nova-compute[75051]:   <features>
Nov 24 18:53:48 user nova-compute[75051]:     <acpi/>
Nov 24 18:53:48 user nova-compute[75051]:     <apic/>
Nov 24 18:53:48 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:53:48 user nova-compute[75051]:   </features>
Nov 24 18:53:48 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:53:48 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:53:48 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:53:48 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:53:48 user nova-compute[75051]:   </clock>
Nov 24 18:53:48 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:53:48 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:53:48 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:53:48 user nova-compute[75051]:   </cpu>
Nov 24 18:53:48 user nova-compute[75051]:   <devices>
Nov 24 18:53:48 user nova-compute[75051]:     <disk type="file" device="cdrom">
Nov 24 18:53:48 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 18:53:48 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/disk.config"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="hda" bus="ide"/>
Nov 24 18:53:48 user nova-compute[75051]:     </disk>
Nov 24 18:53:48 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:48 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:48 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <serial>780459b0-ad74-4a6d-88e9-42bef53d3a11</serial>
Nov 24 18:53:48 user nova-compute[75051]:     </disk>
Nov 24 18:53:48 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:48 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:48 user nova-compute[75051]:       <source dev="/dev/sde"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <serial>aa82bb68-7f8b-45cb-a519-935bbee42636</serial>
Nov 24 18:53:48 user nova-compute[75051]:     </disk>
Nov 24 18:53:48 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:48 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:48 user nova-compute[75051]:       <source dev="/dev/sdg"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="vdc" bus="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <serial>70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8</serial>
Nov 24 18:53:48 user nova-compute[75051]:     </disk>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:4c:e2:a6"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tapf8031932-a2"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:b2:44:4f"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tapb1010f31-a7"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:8d:1a:8a"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tap1482f34a-9d"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:83:4c:d4"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tapea999b70-6d"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:88:ca:6a"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tap8c8e5ee6-9b"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:52:c4:5d"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tapa9d6ec78-0e"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:48 user nova-compute[75051]:       <mac address="fa:16:3e:34:9a:1a"/>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:48 user nova-compute[75051]:       <target dev="tap5aa616a3-c7"/>
Nov 24 18:53:48 user nova-compute[75051]:     </interface>
Nov 24 18:53:48 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:53:48 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/console.log" append="off"/>
Nov 24 18:53:48 user nova-compute[75051]:     </serial>
Nov 24 18:53:48 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:53:48 user nova-compute[75051]:     <video>
Nov 24 18:53:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:48 user nova-compute[75051]:     </video>
Nov 24 18:53:48 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:53:48 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:53:48 user nova-compute[75051]:     </rng>
Nov 24 18:53:48 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:53:48 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:53:48 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:53:48 user nova-compute[75051]:     </memballoon>
Nov 24 18:53:48 user nova-compute[75051]:   </devices>
Nov 24 18:53:48 user nova-compute[75051]: </domain>
Nov 24 18:53:48 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33fdcb0-ff7f-4489-bee5-837b38a55363]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7fba7ded-ef6c-5e80-91d2-a55ccbbc7319', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8031932-a2, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8031932-a2, col_values=(('qos', UUID('e6dee885-e4c1-4eb0-a04d-babfe0095a8e')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8031932-a2, col_values=(('external_ids', {'iface-id': 'f8031932-a2e0-4d12-9f38-04273d53b85a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:e2:a6', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2')
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30b4b9-21b5-4669-ba50-d1ecab84b63a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6de5bcd9-4296-5f25-a3e3-c930d187a4cd', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPyFTihg {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1010f31-a7, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1010f31-a7, col_values=(('qos', UUID('fe289b33-1fb6-424e-bcf6-e1d1736ee493')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1010f31-a7, col_values=(('external_ids', {'iface-id': 'b1010f31-a7d7-4156-9113-a02ab3de36df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:44:4f', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OPyFTihg" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c520aac-80a0-435c-ba55-18301e98b81b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OPyFTihg'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7')
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d337f4-c877-4ee3-be40-794593669891]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ea73277-1016-54fd-b5c8-c8b4dd399cb4', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1482f34a-9d, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1482f34a-9d, col_values=(('qos', UUID('d6dcde99-486a-4197-b45b-bbf2be5f7822')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1482f34a-9d, col_values=(('external_ids', {'iface-id': '1482f34a-9d12-434c-9eb9-cef34a221e9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:1a:8a', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f7630-2740-4411-ae5e-4d2d0e3e0dcc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d')
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5be7e289-f379-50fe-8c39-a75cab96eb6b', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea999b70-6d, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea999b70-6d, col_values=(('qos', UUID('1dd04805-e6d6-4d3e-a4dc-8ee9856e3dbe')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea999b70-6d, col_values=(('external_ids', {'iface-id': 'ea999b70-6d0b-4d3c-a7d7-b627ca5bd920', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:4c:d4', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694831a-e969-4152-b865-3ebb78b4cda1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260]
Nov 24 18:53:48 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260] successful.
Nov 24 18:53:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b834a4eb-a193-4c6c-9c56-e585c57c2519]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:48 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d')
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e29f7d31-0785-5f70-ac40-7fdd88c63020', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c9d313-aa83-4d1a-a8fc-3e47f9fa7168]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:53:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:53:49 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:53:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0bdd8-046e-444f-a422-6bf1da8d39d4]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPyFTihg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8e5ee6-9b, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8e5ee6-9b, col_values=(('qos', UUID('503b58ea-ae78-4842-80e1-1b59d7e394b9')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8e5ee6-9b, col_values=(('external_ids', {'iface-id': '8c8e5ee6-9b37-4c3d-8102-07d3e354d574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:ca:6a', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b')
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14767328-51d2-5c9c-93b7-cd6b7545bf6f', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9d6ec78-0e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9d6ec78-0e, col_values=(('qos', UUID('4c0a75f8-3d89-4e67-ab5d-a39b1a83a2e8')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9d6ec78-0e, col_values=(('external_ids', {'iface-id': 'a9d6ec78-0eee-4f7f-bdeb-7232556cc90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:c4:5d', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e')
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c22db4ee-38e0-536b-a63f-918496af2e6e', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aa616a3-c7, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5aa616a3-c7, col_values=(('qos', UUID('63d89c07-a50f-4377-a7bb-ae958437d39a')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5aa616a3-c7, col_values=(('external_ids', {'iface-id': '5aa616a3-c72a-46a9-874e-ea0ba316edfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:9a:1a', 'vm-uuid': 'e1ff9da6-e31d-49f6-a48f-56a2c4866686'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:49 user nova-compute[75051]: INFO os_vif [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7')
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] No BDM found with device name hda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] No VIF found with MAC fa:16:3e:4c:e2:a6, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] No VIF found with MAC fa:16:3e:88:ca:6a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:53:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Using config drive
Nov 24 18:53:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Creating config drive at /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/disk.config
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuusxk0_y {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuusxk0_y" returned: 0 in 0.051s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== connect_volume: return (2652ms) {'type': 'block', 'scsi_wwn': '23334396130396466', 'path': '/dev/sdh'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334396130396466', 'path': '/dev/sdh'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lazy-loading 'pci_devices' on Instance uuid 00a95e25-c59c-46f7-9aeb-d3f01146c189 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:53:50 user nova-compute[75051]:   <uuid>00a95e25-c59c-46f7-9aeb-d3f01146c189</uuid>
Nov 24 18:53:50 user nova-compute[75051]:   <name>instance-0000000a</name>
Nov 24 18:53:50 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:53:50 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:53:50 user nova-compute[75051]:   <metadata>
Nov 24 18:53:50 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:53:50 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:name>tempest-device-tagging-server-510949010</nova:name>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:53:42</nova:creationTime>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:53:50 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:53:50 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:owner>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:user uuid="f61bed5ee29e4282acf077e10b140e97">tempest-TaggedBootDevicesTest-198222194-project-member</nova:user>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:project uuid="9dea95244ac640c59516fbcda9f1e028">tempest-TaggedBootDevicesTest-198222194</nova:project>
Nov 24 18:53:50 user nova-compute[75051]:       </nova:owner>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:53:50 user nova-compute[75051]:       <nova:ports>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="a5a438c0-7817-4d84-b3a9-c91f51a1d36c">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="ba629722-f270-40f0-920c-0bf684e25d75">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="1338870f-d540-4072-aa99-240541f1ccdc">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="23b4241b-6f88-481e-bd3e-bfa0c91f2ec9">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="86285a16-45ce-4fee-9115-d196637cccf3">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="6a7b4267-a8c3-4237-ad90-884dee0e889c">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:         <nova:port uuid="53ad060d-cc1f-4417-9732-27af3a1b8589">
Nov 24 18:53:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 24 18:53:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:53:50 user nova-compute[75051]:       </nova:ports>
Nov 24 18:53:50 user nova-compute[75051]:     </nova:instance>
Nov 24 18:53:50 user nova-compute[75051]:   </metadata>
Nov 24 18:53:50 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:53:50 user nova-compute[75051]:     <system>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="serial">00a95e25-c59c-46f7-9aeb-d3f01146c189</entry>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="uuid">00a95e25-c59c-46f7-9aeb-d3f01146c189</entry>
Nov 24 18:53:50 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:53:50 user nova-compute[75051]:     </system>
Nov 24 18:53:50 user nova-compute[75051]:   </sysinfo>
Nov 24 18:53:50 user nova-compute[75051]:   <os>
Nov 24 18:53:50 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:53:50 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:53:50 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:53:50 user nova-compute[75051]:   </os>
Nov 24 18:53:50 user nova-compute[75051]:   <features>
Nov 24 18:53:50 user nova-compute[75051]:     <acpi/>
Nov 24 18:53:50 user nova-compute[75051]:     <apic/>
Nov 24 18:53:50 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:53:50 user nova-compute[75051]:   </features>
Nov 24 18:53:50 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:53:50 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:53:50 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:53:50 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:53:50 user nova-compute[75051]:   </clock>
Nov 24 18:53:50 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:53:50 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:53:50 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:53:50 user nova-compute[75051]:   </cpu>
Nov 24 18:53:50 user nova-compute[75051]:   <devices>
Nov 24 18:53:50 user nova-compute[75051]:     <disk type="file" device="cdrom">
Nov 24 18:53:50 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none"/>
Nov 24 18:53:50 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/disk.config"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="hda" bus="ide"/>
Nov 24 18:53:50 user nova-compute[75051]:     </disk>
Nov 24 18:53:50 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:50 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:50 user nova-compute[75051]:       <source dev="/dev/sdd"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <serial>cdc277a3-1626-4f22-962f-9e0ebe78b07b</serial>
Nov 24 18:53:50 user nova-compute[75051]:     </disk>
Nov 24 18:53:50 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:50 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:50 user nova-compute[75051]:       <source dev="/dev/sdf"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <serial>0e6ec4e5-b335-495e-adf3-d1cdbd9944c7</serial>
Nov 24 18:53:50 user nova-compute[75051]:     </disk>
Nov 24 18:53:50 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:53:50 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:53:50 user nova-compute[75051]:       <source dev="/dev/sdh"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="vdc" bus="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <serial>1c4e566d-4616-4018-bc66-37e9a42fbc5a</serial>
Nov 24 18:53:50 user nova-compute[75051]:     </disk>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:0e:31:1b"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tapa5a438c0-78"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:c8:9c:43"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tapba629722-f2"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:a4:7b:ed"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tap1338870f-d5"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:f4:b1:58"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tap23b4241b-6f"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:32:8e:13"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tap86285a16-45"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:0d:c0:05"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tap6a7b4267-a8"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:53:50 user nova-compute[75051]:       <mac address="fa:16:3e:cb:0d:ea"/>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:53:50 user nova-compute[75051]:       <target dev="tap53ad060d-cc"/>
Nov 24 18:53:50 user nova-compute[75051]:     </interface>
Nov 24 18:53:50 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:53:50 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/console.log" append="off"/>
Nov 24 18:53:50 user nova-compute[75051]:     </serial>
Nov 24 18:53:50 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:53:50 user nova-compute[75051]:     <video>
Nov 24 18:53:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:53:50 user nova-compute[75051]:     </video>
Nov 24 18:53:50 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:53:50 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:53:50 user nova-compute[75051]:     </rng>
Nov 24 18:53:50 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:53:50 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:53:50 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:53:50 user nova-compute[75051]:     </memballoon>
Nov 24 18:53:50 user nova-compute[75051]:   </devices>
Nov 24 18:53:50 user nova-compute[75051]: </domain>
Nov 24 18:53:50 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '071decfd-d305-594e-b0d8-e448a00f6cd6', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5a438c0-78, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5a438c0-78, col_values=(('qos', UUID('b34eba4d-9d48-45bb-a104-19f946a0f6b2')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5a438c0-78, col_values=(('external_ids', {'iface-id': 'a5a438c0-7817-4d84-b3a9-c91f51a1d36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:31:1b', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78')
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d1482bc-9c25-5bda-a4dd-4024b7d576ca', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba629722-f2, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba629722-f2, col_values=(('qos', UUID('0e5286e8-4110-4491-896e-08c190591ef6')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba629722-f2, col_values=(('external_ids', {'iface-id': 'ba629722-f270-40f0-920c-0bf684e25d75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:9c:43', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2')
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a3f1fe6-4ec8-5e2f-b462-70c9fe486218', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1338870f-d5, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1338870f-d5, col_values=(('qos', UUID('937913db-ab9c-4013-b456-7dcb9afb6eba')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1338870f-d5, col_values=(('external_ids', {'iface-id': '1338870f-d540-4072-aa99-240541f1ccdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7b:ed', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5')
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72fdc9f5-e7f2-5233-aaa5-923b24b63b26', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23b4241b-6f, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23b4241b-6f, col_values=(('qos', UUID('0861688c-e93d-4fec-bcd2-9dbea29123f9')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23b4241b-6f, col_values=(('external_ids', {'iface-id': '23b4241b-6f88-481e-bd3e-bfa0c91f2ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b1:58', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f')
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a687036-a4b6-57bc-ba3b-3b76e654ac73', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86285a16-45, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86285a16-45, col_values=(('qos', UUID('bb8062bc-fdb0-4e05-9e87-1e574833aa56')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86285a16-45, col_values=(('external_ids', {'iface-id': '86285a16-45ce-4fee-9115-d196637cccf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:8e:13', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45')
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd067dc17-0b03-573b-82c8-c908eba89831', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a7b4267-a8, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a7b4267-a8, col_values=(('qos', UUID('6abb7af8-5225-46d7-b01a-ca66dd354000')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a7b4267-a8, col_values=(('external_ids', {'iface-id': '6a7b4267-a8c3-4237-ad90-884dee0e889c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:c0:05', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:51 user nova-compute[75051]: WARNING nova.compute.manager [req-7a702ddf-9fcf-43d2-910e-28a8dcb95aa6 req-b06f7297-88fe-453c-abd9-785cfc4464a6 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a for instance with vm_state building and task_state spawning.
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8')
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:53:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f48ecb4d-eb7b-559c-a13d-e06383b148e5', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ad060d-cc, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53ad060d-cc, col_values=(('qos', UUID('a17ffbb1-185b-4c64-be23-e4bff6f68e66')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53ad060d-cc, col_values=(('external_ids', {'iface-id': '53ad060d-cc1f-4417-9732-27af3a1b8589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:0d:ea', 'vm-uuid': '00a95e25-c59c-46f7-9aeb-d3f01146c189'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:51 user nova-compute[75051]: WARNING nova.compute.manager [req-db5fbe04-a2d5-4815-9867-dbba2a1bc3e9 req-14438ba5-f23e-42c7-a403-444b24581caf service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df for instance with vm_state building and task_state spawning.
Nov 24 18:53:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: INFO os_vif [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc')
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] No BDM found with device name hda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] No VIF found with MAC fa:16:3e:0e:31:1b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] No VIF found with MAC fa:16:3e:32:8e:13, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:53:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Using config drive
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Creating config drive at /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/disk.config
Nov 24 18:53:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp97l9ivc_ {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp97l9ivc_" returned: 0 in 0.056s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-d7574254-ac41-4988-ae03-1b27fa733351 req-99fc2081-adc3-4528-abcd-0fe5e95a59e3 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7e966152-1a33-40bd-bfdb-e81fad4cab95 req-13a21e2c-ddb7-4649-b364-c2b2be90f7ae service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 for instance with vm_state building and task_state spawning.
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:54 user nova-compute[75051]: WARNING nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df for instance with vm_state building and task_state spawning.
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:54 user nova-compute[75051]: WARNING nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 for instance with vm_state building and task_state spawning.
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:54 user nova-compute[75051]: WARNING nova.compute.manager [req-c6ffd78b-e025-4c91-87b1-231bf9f121e4 req-2e015a92-49ba-4fbd-beb8-baf62942a150 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 for instance with vm_state building and task_state spawning.
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:55 user nova-compute[75051]: WARNING nova.compute.manager [req-c4e0400c-60e4-4bbc-9d4b-6f226eed1221 req-de1a465a-80d5-4482-94b2-8447207c76e9 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a for instance with vm_state building and task_state spawning.
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:55 user nova-compute[75051]: WARNING nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa for instance with vm_state building and task_state spawning.
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:55 user nova-compute[75051]: WARNING nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa for instance with vm_state building and task_state spawning.
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:55 user nova-compute[75051]: WARNING nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 for instance with vm_state building and task_state spawning.
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:55 user nova-compute[75051]: WARNING nova.compute.manager [req-d3d9d1c2-0d3c-4be8-b8f6-d32bcf87f1c6 req-b4875e34-b6a0-4fa5-acbb-a6c0ee6f2995 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 for instance with vm_state building and task_state spawning.
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:56 user nova-compute[75051]: WARNING nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c for instance with vm_state building and task_state spawning.
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:56 user nova-compute[75051]: WARNING nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c for instance with vm_state building and task_state spawning.
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:56 user nova-compute[75051]: WARNING nova.compute.manager [req-46df54fb-b210-4c66-8dbb-1a08cb61c7aa req-ccca4e77-59f5-4e6f-bed0-6b46ce3d91ab service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 for instance with vm_state building and task_state spawning.
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance spawned successfully.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: INFO nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Took 16.28 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:57 user nova-compute[75051]: INFO nova.compute.manager [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Took 39.40 seconds to build instance.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bee6068-ecb8-4316-bc41-b412502b0446 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.507s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c for instance with vm_state building and task_state spawning.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-2d8d03a8-1be3-4b94-ad7b-0fb72659740d req-a0e5d8af-d41b-4404-8349-a9205136dbe1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c for instance with vm_state building and task_state spawning.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc for instance with vm_state building and task_state spawning.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc for instance with vm_state building and task_state spawning.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 for instance with vm_state building and task_state spawning.
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:57 user nova-compute[75051]: WARNING nova.compute.manager [req-d97b4130-5f62-41e8-b15c-b65840949bcc req-f54c5454-800b-4eb9-8fa2-9b103d7348a2 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 for instance with vm_state building and task_state spawning.
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:58 user nova-compute[75051]: WARNING nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 for instance with vm_state building and task_state spawning.
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:58 user nova-compute[75051]: WARNING nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 for instance with vm_state building and task_state spawning.
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:53:58 user nova-compute[75051]: WARNING nova.compute.manager [req-a5ab7bca-28a0-4a0f-aca7-331e660901d9 req-c17d29c8-5b38-4cc9-a3b9-4071040b1d71 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 for instance with vm_state building and task_state spawning.
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:53:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance spawned successfully.
Nov 24 18:53:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:53:59 user nova-compute[75051]: INFO nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Took 16.76 seconds to spawn the instance on the hypervisor.
Nov 24 18:53:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:53:59 user nova-compute[75051]: INFO nova.compute.manager [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Took 41.36 seconds to build instance.
Nov 24 18:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-037b16c9-50e3-4f26-8bcd-a8a945996680 tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.481s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:04 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lazy-loading 'flavor' on Instance uuid fe0ec57a-6937-4277-a62f-22aa0622d06e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.246s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:06 user nova-compute[75051]: INFO nova.compute.manager [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Attaching volume ec14b91d-926a-4b7a-ad12-8ef2b20b0877 to /dev/vdb
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG os_brick.utils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9455400a-89a3-4e7f-9697-1f282dbcf99c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f30b9-5016-4720-9bc4-0fcdf22cdd6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504bed0-e5f2-4454-9bf3-7de51cf02502]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22df59a3-f454-4e00-8576-605eeba65cf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:07 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec3fbf-761f-4a77-a50e-7216dec80192]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG os_brick.utils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating existing volume attachment record: 9fcff25a-5425-408d-8a2e-28455e3dbdd0 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:54:07 user nova-compute[75051]: INFO nova.compute.manager [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] instance snapshotting
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Beginning live snapshot process
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99.delta 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99.delta 1073741824" returned: 0 in 0.048s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 18:54:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75051) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 24 18:54:08 user nova-compute[75051]: INFO nova.virt.libvirt.host [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] UEFI support detected
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:54:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:54:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:54:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=6997MB free_disk=25.638233184814453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:54:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:54:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99.delta /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fe0ec57a-6937-4277-a62f-22aa0622d06e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f0410591-5d5c-473a-93a9-283730abc348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bec46576-e2b6-4bc9-8648-5cc341ac2144 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 00a95e25-c59c-46f7-9aeb-d3f01146c189 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:54:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99.delta /opt/stack/data/nova/instances/snapshots/tmp9ldpwxkm/94cef2871eb04db5bd3493831fc3ba99" returned: 0 in 0.856s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:10 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Snapshot extracted, beginning image upload
Nov 24 18:54:10 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-changed-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Refreshing instance network info cache due to event network-changed-3477becc-b128-4274-84c5-37633e88d5eb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Refreshing network info cache for port 3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.169s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updated VIF entry in instance network info cache for port 3477becc-b128-4274-84c5-37633e88d5eb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7bbf8969-6ef8-4074-b2cd-1923c4bb11c5 req-d099084b-1e2c-4b23-9f54-e5cfa12ef8d4 service nova] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:54:14 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Snapshot image upload complete
Nov 24 18:54:14 user nova-compute[75051]: INFO nova.compute.manager [None req-86459322-1bc4-4a9d-a7bd-07307806628f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Took 7.14 seconds to snapshot the instance on the hypervisor.
Nov 24 18:54:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjlrDVGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:15 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260" returned: 21 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a5b6ec-3537-4366-9370-832fb26f947c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:15 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acdd13e-4c8e-4332-b62a-a01723b3ce7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877] added
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6131a35-6644-4b59-b559-90f803f192cd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87853164-5a30-4b48-9370-bd751730f840]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjlrDVGi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tjlrDVGi" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d59eb3-075f-4d7b-a0ae-3a2baa6953fc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tjlrDVGi'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24c5b49-0bc9-4892-a962-9c4913d3f70c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9192ac-5c2b-4aba-8bce-38b45dc18ae2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ded6a-d19b-4c28-bc9d-e9451c98ab11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260]
Nov 24 18:54:15 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007f21b-4dfd-4d73-ac8f-7f6e6515f73d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd422a6-6fd5-4f61-9cc7-d0de92cdcb3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:15 user nova-compute[75051]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)
Nov 24 18:54:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d18e85e-b8d7-4ff9-aa22-b0491752cfac]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjlrDVGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26335316631646136', 'path': '/dev/sdi'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335316631646136', 'path': '/dev/sdi'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lazy-loading 'flavor' on Instance uuid fe0ec57a-6937-4277-a62f-22aa0622d06e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:54:16 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:16 user nova-compute[75051]:   <source dev="/dev/sdi"/>
Nov 24 18:54:16 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:16 user nova-compute[75051]:   <serial>ec14b91d-926a-4b7a-ad12-8ef2b20b0877</serial>
Nov 24 18:54:16 user nova-compute[75051]: </disk>
Nov 24 18:54:16 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing instance network info cache due to event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:16 user nova-compute[75051]: DEBUG nova.network.neutron [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:17 user nova-compute[75051]: DEBUG nova.network.neutron [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updated VIF entry in instance network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:17 user nova-compute[75051]: DEBUG nova.network.neutron [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ec05c7b-a2b3-454e-be55-6c3ccb8feae3 req-ea98a465-523b-4e2c-a03b-4a6036e6f38d service nova] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] No VIF found with MAC fa:16:3e:33:3c:25, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad0b07f3-81e9-48dc-9810-81cdcbdc6a20 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.159s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:54:19 user nova-compute[75051]: INFO nova.compute.manager [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] instance snapshotting
Nov 24 18:54:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Beginning live snapshot process
Nov 24 18:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json -f qcow2" returned: 0 in 0.371s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:20 user nova-compute[75051]: INFO nova.compute.manager [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Terminating instance
Nov 24 18:54:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665.delta 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665.delta 1073741824" returned: 0 in 0.056s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 18:54:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-unplugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] No waiting events found dispatching network-vif-unplugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-30e7c8b1-394a-4df5-ace7-6ccdb3487154 req-74bb72c6-038f-4d4f-b8cd-c0f0b2b6811c service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-unplugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Instance destroyed successfully.
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.objects.instance [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lazy-loading 'resources' on Instance uuid fe0ec57a-6937-4277-a62f-22aa0622d06e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1527989276',display_name='tempest-DeleteServersTestJSON-server-1527989276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1527989276',id=1,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e12bc28982604e84b0e547fd2021b02f',ramdisk_id='',reservation_id='r-b38loojj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-270965211',owner_user_name='tempest-DeleteServersTestJSON-270965211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:52:29Z,user_data=None,user_id='7977fbf6aa50419886a5bfc2e1fc8b63',uuid=fe0ec57a-6937-4277-a62f-22aa0622d06e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converting VIF {"id": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "address": "fa:16:3e:33:3c:25", "network": {"id": "b455ccdc-903c-404f-9996-7ec1dbabb409", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2140646442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e12bc28982604e84b0e547fd2021b02f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241bd5bb-67", "ovs_interfaceid": "241bd5bb-67b6-49d0-9a92-1c3341d4797c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_vif [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap241bd5bb-67, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f808be6-cb0c-4e6a-95af-a282477a874e) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: INFO os_vif [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3c:25,bridge_name='br-int',has_traffic_filtering=True,id=241bd5bb-67b6-49d0-9a92-1c3341d4797c,network=Network(b455ccdc-903c-404f-9996-7ec1dbabb409),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241bd5bb-67')
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tjlrDVGi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:21 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9315a7-e1c7-4a93-9837-e1f00e0639fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:54:21 user nova-compute[75051]: No targets found.
Nov 24 18:54:21 user nova-compute[75051]: iSNS:
Nov 24 18:54:21 user nova-compute[75051]: No targets found.
Nov 24 18:54:21 user nova-compute[75051]: STATIC:
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:54:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:21 user nova-compute[75051]: FIRMWARE:
Nov 24 18:54:21 user nova-compute[75051]: No targets found.
Nov 24 18:54:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:54:21 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:54:21 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf63fdb-e426-4a4f-82bd-c7e572a76c64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[defa9d72-f753-4182-9e6a-5da8e4459e2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:21 user nova-compute[75051]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 (non-flash)
Nov 24 18:54:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c01a23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877'): ({'sdi'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Removing single pathed devices sdi {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a673ca-5601-4712-bc9e-cdde947a227e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c94bd2-0b22-4f5b-b9ff-1e33065e7688]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Flushing IO for device /dev/sdi {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56bf45d-fef7-434f-94d2-4f69bbac3755]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.036s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6766193f-9f4a-4dba-8434-fe106058b31d]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26335316631646136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a04bb6a', '/dev/disk/by-id/scsi-1SCST_BIO4a04bb6a-c51f1da68f089906') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f874f2a-0e32-4095-85bb-b177e4e0b572]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665.delta /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95709615-793f-4260-97d3-3a58df051a18]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[91607631-dea7-4edc-a775-d8bd4a7b9b9b]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260]
Nov 24 18:54:21 user nova-compute[75051]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec14b91d-926a-4b7a-ad12-8ef2b20b0877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a035b415-863d-4e30-960f-063a6b7149ee]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] <== disconnect_volume: return (421ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Deleting instance files /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e_del
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Deletion of /opt/stack/data/nova/instances/fe0ec57a-6937-4277-a62f-22aa0622d06e_del complete
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.compute.manager [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Took 1.85 seconds to destroy the instance on the hypervisor.
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:54:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665.delta /opt/stack/data/nova/instances/snapshots/tmphdfeellr/e1f1fb91e4d748e19b9c781d21732665" returned: 0 in 0.262s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Snapshot extracted, beginning image upload
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:22 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Took 0.67 seconds to deallocate network for instance.
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-c147455f-badd-46ee-9952-cf08b6e35fee req-69bc7f1f-b0d2-4df1-a013-30bf911ff984 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-deleted-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:22 user nova-compute[75051]: INFO nova.compute.manager [req-c147455f-badd-46ee-9952-cf08b6e35fee req-69bc7f1f-b0d2-4df1-a013-30bf911ff984 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Neutron deleted interface 241bd5bb-67b6-49d0-9a92-1c3341d4797c; detaching it from the instance and deleting it from the info cache
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-c147455f-badd-46ee-9952-cf08b6e35fee req-69bc7f1f-b0d2-4df1-a013-30bf911ff984 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] Acquiring lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] No waiting events found dispatching network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:22 user nova-compute[75051]: WARNING nova.compute.manager [req-29400e00-ec37-4b32-aa96-232c0a8f8925 req-ac6e209a-c4f3-4827-a320-6843e3d89329 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Received unexpected event network-vif-plugged-241bd5bb-67b6-49d0-9a92-1c3341d4797c for instance with vm_state active and task_state deleting.
Nov 24 18:54:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-c147455f-badd-46ee-9952-cf08b6e35fee req-69bc7f1f-b0d2-4df1-a013-30bf911ff984 service nova] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Detach interface failed, port_id=241bd5bb-67b6-49d0-9a92-1c3341d4797c, reason: Instance fe0ec57a-6937-4277-a62f-22aa0622d06e could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:54:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Snapshot image upload complete
Nov 24 18:54:24 user nova-compute[75051]: INFO nova.compute.manager [None req-788b59b9-9619-425f-a97f-2bd6614dfe4a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Took 5.41 seconds to snapshot the instance on the hypervisor.
Nov 24 18:54:25 user nova-compute[75051]: INFO nova.compute.manager [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] [instance: fe0ec57a-6937-4277-a62f-22aa0622d06e] Took 3.29 seconds to detach 1 volumes for instance.
Nov 24 18:54:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:26 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:54:26 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:54:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:26 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Deleted allocations for instance fe0ec57a-6937-4277-a62f-22aa0622d06e
Nov 24 18:54:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-576f1635-5683-494f-ab47-5c8bba2a33a3 tempest-DeleteServersTestJSON-270965211 tempest-DeleteServersTestJSON-270965211-project-member] Lock "fe0ec57a-6937-4277-a62f-22aa0622d06e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.421s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:54:29 user nova-compute[75051]: INFO nova.compute.claims [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Claim successful on node user
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:54:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.policy [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c14d0f83b34441f998e48bf56844dec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae522b213c4592acb5df152b4266a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:54:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Creating image(s)
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "/opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "/opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk 1073741824" returned: 0 in 0.056s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Successfully created port: 8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Cannot resize image /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Ensure instance console log exists: /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Successfully updated port: 8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquired lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-changed-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Refreshing instance network info cache due to event network-changed-8885bff7-e697-40e4-a3e9-e31a53583e3c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] Acquiring lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updating instance_info_cache with network_info: [{"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Releasing lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Instance network_info: |[{"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] Acquired lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Refreshing network info cache for port 8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Start _get_guest_xml network_info=[{"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:54:31 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:54:31 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1563895742',display_name='tempest-VolumesSnapshotTestJSON-instance-1563895742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1563895742',id=12,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGAIGMIctP5fla5OH5VT+3WwCGbt2K0J2sRe2oZgvlStxRtuIOpSTOeo5T9VcCIF37cj+t9b0ZqtcFmOO5VwXz3AvYuE4n+bg8T+JytFamyoN/VK4Fg/LPAjDbflsg1KQ==',key_name='tempest-keypair-1949062510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-hi7ago0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=1ee44d98-b374-4d33-add8-d55fc15309cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.objects.instance [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:54:31 user nova-compute[75051]:   <uuid>1ee44d98-b374-4d33-add8-d55fc15309cc</uuid>
Nov 24 18:54:31 user nova-compute[75051]:   <name>instance-0000000c</name>
Nov 24 18:54:31 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:54:31 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:54:31 user nova-compute[75051]:   <metadata>
Nov 24 18:54:31 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:54:31 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1563895742</nova:name>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:54:31</nova:creationTime>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:54:31 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:54:31 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:owner>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:user uuid="c14d0f83b34441f998e48bf56844dec8">tempest-VolumesSnapshotTestJSON-1332746489-project-member</nova:user>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:project uuid="b2ae522b213c4592acb5df152b4266a0">tempest-VolumesSnapshotTestJSON-1332746489</nova:project>
Nov 24 18:54:31 user nova-compute[75051]:       </nova:owner>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:54:31 user nova-compute[75051]:       <nova:ports>
Nov 24 18:54:31 user nova-compute[75051]:         <nova:port uuid="8885bff7-e697-40e4-a3e9-e31a53583e3c">
Nov 24 18:54:31 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 24 18:54:31 user nova-compute[75051]:         </nova:port>
Nov 24 18:54:31 user nova-compute[75051]:       </nova:ports>
Nov 24 18:54:31 user nova-compute[75051]:     </nova:instance>
Nov 24 18:54:31 user nova-compute[75051]:   </metadata>
Nov 24 18:54:31 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:54:31 user nova-compute[75051]:     <system>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="serial">1ee44d98-b374-4d33-add8-d55fc15309cc</entry>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="uuid">1ee44d98-b374-4d33-add8-d55fc15309cc</entry>
Nov 24 18:54:31 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:54:31 user nova-compute[75051]:     </system>
Nov 24 18:54:31 user nova-compute[75051]:   </sysinfo>
Nov 24 18:54:31 user nova-compute[75051]:   <os>
Nov 24 18:54:31 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:54:31 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:54:31 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:54:31 user nova-compute[75051]:   </os>
Nov 24 18:54:31 user nova-compute[75051]:   <features>
Nov 24 18:54:31 user nova-compute[75051]:     <acpi/>
Nov 24 18:54:31 user nova-compute[75051]:     <apic/>
Nov 24 18:54:31 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:54:31 user nova-compute[75051]:   </features>
Nov 24 18:54:31 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:54:31 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:54:31 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:54:31 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:54:31 user nova-compute[75051]:   </clock>
Nov 24 18:54:31 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:54:31 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:54:31 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:54:31 user nova-compute[75051]:   </cpu>
Nov 24 18:54:31 user nova-compute[75051]:   <devices>
Nov 24 18:54:31 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:54:31 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:54:31 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk"/>
Nov 24 18:54:31 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:54:31 user nova-compute[75051]:     </disk>
Nov 24 18:54:31 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:54:31 user nova-compute[75051]:       <mac address="fa:16:3e:ea:66:39"/>
Nov 24 18:54:31 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:54:31 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:54:31 user nova-compute[75051]:       <target dev="tap8885bff7-e6"/>
Nov 24 18:54:31 user nova-compute[75051]:     </interface>
Nov 24 18:54:31 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:54:31 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/console.log" append="off"/>
Nov 24 18:54:31 user nova-compute[75051]:     </serial>
Nov 24 18:54:31 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:54:31 user nova-compute[75051]:     <video>
Nov 24 18:54:31 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:54:31 user nova-compute[75051]:     </video>
Nov 24 18:54:31 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:54:31 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:54:31 user nova-compute[75051]:     </rng>
Nov 24 18:54:31 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:54:31 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:54:31 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:54:31 user nova-compute[75051]:     </memballoon>
Nov 24 18:54:31 user nova-compute[75051]:   </devices>
Nov 24 18:54:31 user nova-compute[75051]: </domain>
Nov 24 18:54:31 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1563895742',display_name='tempest-VolumesSnapshotTestJSON-instance-1563895742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1563895742',id=12,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGAIGMIctP5fla5OH5VT+3WwCGbt2K0J2sRe2oZgvlStxRtuIOpSTOeo5T9VcCIF37cj+t9b0ZqtcFmOO5VwXz3AvYuE4n+bg8T+JytFamyoN/VK4Fg/LPAjDbflsg1KQ==',key_name='tempest-keypair-1949062510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-hi7ago0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=1ee44d98-b374-4d33-add8-d55fc15309cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG os_vif [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e62e1227-246a-5346-b307-a9dad24cdc89', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8885bff7-e6, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8885bff7-e6, col_values=(('qos', UUID('68944e2f-1f6b-468c-b03a-92d18727c66d')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8885bff7-e6, col_values=(('external_ids', {'iface-id': '8885bff7-e697-40e4-a3e9-e31a53583e3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:66:39', 'vm-uuid': '1ee44d98-b374-4d33-add8-d55fc15309cc'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:31 user nova-compute[75051]: INFO os_vif [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6')
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No VIF found with MAC fa:16:3e:ea:66:39, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updated VIF entry in instance network info cache for port 8885bff7-e697-40e4-a3e9-e31a53583e3c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updating instance_info_cache with network_info: [{"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b9d41e4-0ed9-4dc7-a8ae-52ae33f50744 req-67682850-9e2a-485a-8172-ec6be9a5bbfb service nova] Releasing lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-changed-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Refreshing instance network info cache due to event network-changed-7cd6266f-d44e-44a9-8033-3e977fe8e3a0. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] Acquiring lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] Acquired lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG nova.network.neutron [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Refreshing network info cache for port 7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lazy-loading 'flavor' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] No waiting events found dispatching network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:33 user nova-compute[75051]: WARNING nova.compute.manager [req-43d10265-fc9d-43f9-8f14-e5d78d88c7c8 req-aac7bbb9-9321-42bc-be34-30762924bfe9 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received unexpected event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c for instance with vm_state building and task_state spawning.
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:33 user nova-compute[75051]: INFO nova.compute.manager [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Attaching volume 522231b5-d7b1-4ad2-b620-67977be73080 to /dev/vdb
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.network.neutron [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updated VIF entry in instance network info cache for port 7cd6266f-d44e-44a9-8033-3e977fe8e3a0. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.network.neutron [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updating instance_info_cache with network_info: [{"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-20cca987-e021-41cd-bc76-11473b331cf2 req-3f58bf04-9a40-450a-b927-10c2129a641d service nova] Releasing lock "refresh_cache-e0d31370-4bdb-4804-b1d5-5e4a19a41912" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.utils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1428c-f0e2-4d20-a529-37b3c5d0e04d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[120640f9-29a6-4cff-8273-688fca1d6f24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96c9cd-b0f0-43f1-a893-9a2a408b7c58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22470114-01e6-429a-97c0-0babc83d23b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:33 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ad9d3-f1b4-42ee-9072-81b5a0595bb0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG os_brick.utils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updating existing volume attachment record: 7cdeb96d-1f50-4ca0-900f-a3588cd2ba9d {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] No waiting events found dispatching network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:35 user nova-compute[75051]: WARNING nova.compute.manager [req-9752f45a-64fc-46a3-b11a-86f187164e40 req-ed59dc75-dd7f-4059-b568-16d92de71c4b service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received unexpected event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c for instance with vm_state building and task_state spawning.
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:54:35 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Instance spawned successfully.
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:54:35 user nova-compute[75051]: INFO nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 24 18:54:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:54:35 user nova-compute[75051]: INFO nova.compute.manager [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Took 6.64 seconds to build instance.
Nov 24 18:54:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4ff87391-0928-4ae5-bec2-7f16f48528e3 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.740s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-changed-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Refreshing instance network info cache due to event network-changed-d7abb801-e462-4749-8349-13f953f5d61b. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] Acquiring lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] Acquired lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG nova.network.neutron [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Refreshing network info cache for port d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lazy-loading 'flavor' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:38 user nova-compute[75051]: INFO nova.compute.manager [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attaching volume af63b8b8-762f-4c61-94cd-7d1407ae2f53 to /dev/vdb
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.utils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1663f23d-deeb-4bb6-bdba-da635622c450]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1446dc0c-3d4c-4cfd-86e6-9673d544657b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62acb1-8658-4a4a-946d-e63074dac645]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe33edf-696a-43f0-b9de-c29de6d6c0f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:38 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb515a3-d88a-42da-a1dc-1ea5b06199d7]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG os_brick.utils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updating existing volume attachment record: 94ace589-19aa-479f-a5b5-8b9606091a66 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-changed-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing instance network info cache due to event network-changed-100a87c1-4a68-4946-a293-96ace9269687. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing network info cache for port 100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updated VIF entry in instance network info cache for port d7abb801-e462-4749-8349-13f953f5d61b. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updating instance_info_cache with network_info: [{"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0bb0a8ad-b10b-4732-a586-ac63f5106552 req-43f4817a-5e61-4357-ba86-852cebb1b7af service nova] Releasing lock "refresh_cache-f0410591-5d5c-473a-93a9-283730abc348" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updated VIF entry in instance network info cache for port 100a87c1-4a68-4946-a293-96ace9269687. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ce8445c0-5659-4566-80ba-3921c9505daf req-3d8f2c3d-cc7e-4d7e-aa11-aa0b4a7aee8c service nova] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'pci_requests' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.objects.base [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Object Instance<197a4531-4f1f-40b1-b8b9-03a2ad5e47bd> lazy-loaded attributes: flavor,pci_requests {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.policy [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'acd941243b164658bf180f3c31cb732d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977597f2a324ed4ba4ca3794b12957f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-changed-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Refreshing instance network info cache due to event network-changed-023e6dbb-607c-4da2-a30a-757bd15faca9. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] Acquiring lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] Acquired lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Refreshing network info cache for port 023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updated VIF entry in instance network info cache for port 023e6dbb-607c-4da2-a30a-757bd15faca9. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updating instance_info_cache with network_info: [{"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Successfully created port: 5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:54:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d03378d-9913-4e92-9ccd-0ea5be55d95a req-f0a5d4fc-5faa-4889-825b-abb948bc4167 service nova] Releasing lock "refresh_cache-b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjSnvRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:41 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:41 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:41 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d38df-ff62-4f98-b5cf-d8698685879c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:41 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d1842d-92ba-4491-9b4e-1e8c086ac188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080] added
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b222be2c-6bc0-4e31-a427-6044edcb3a1f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db04d0c-4cdc-419c-9aa9-4d5583a8f7be]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjSnvRYJ {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjSnvRYJ" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d795d1-dc4e-4dbf-b113-c059ee21b8de]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjSnvRYJ'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[529fcf46-fdf8-4e40-bebe-5e3c87e4d767]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce97b5b-80bb-4947-9d6c-4ba9a6c76872]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73737237-af35-4f1c-99cb-ff60dcb88b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260]
Nov 24 18:54:41 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc963ac-634e-48ae-ad62-61b0befdbb18]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf5144a-3c58-47df-8aac-36091c393aca]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:41 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:41 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Successfully updated port: 5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b7cf5e-f39b-454f-a1ea-1e4e29ceba54]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjSnvRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-changed-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing instance network info cache due to event network-changed-5e5384ce-daff-46e4-bb67-d17297060d4b. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lazy-loading 'flavor' on Instance uuid b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.neutron [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Refreshing network info cache for port 5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_vif [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bad48245-b483-5721-9024-41cc8c6113ea', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e5384ce-da, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e5384ce-da, col_values=(('qos', UUID('d6b36a55-91bf-442b-924d-cc9db906774d')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e5384ce-da, col_values=(('external_ids', {'iface-id': '5e5384ce-daff-46e4-bb67-d17297060d4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:c0:bf', 'vm-uuid': '197a4531-4f1f-40b1-b8b9-03a2ad5e47bd'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: INFO os_vif [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da')
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] attach device xml: <interface type="ethernet">
Nov 24 18:54:42 user nova-compute[75051]:   <mac address="fa:16:3e:70:c0:bf"/>
Nov 24 18:54:42 user nova-compute[75051]:   <model type="virtio"/>
Nov 24 18:54:42 user nova-compute[75051]:   <mtu size="1442"/>
Nov 24 18:54:42 user nova-compute[75051]:   <target dev="tap5e5384ce-da"/>
Nov 24 18:54:42 user nova-compute[75051]: </interface>
Nov 24 18:54:42 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:42 user nova-compute[75051]: INFO nova.compute.manager [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Attaching volume d5b649f9-bad0-4b34-9d2e-aac33a48cf22 to /dev/sdc
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.utils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd7d199-8975-48dd-bbcd-ed3cd7cdbabd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[23476165-48b6-4e88-98fa-eb6270601b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f189b6-0971-4866-8fb8-382fa71939a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[591a4f03-33e8-4b55-82fd-983ccd34c290]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23431343466376531', 'path': '/dev/sdi'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431343466376531', 'path': '/dev/sdi'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:42 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[659aabeb-6181-465e-8aea-1a3302681ec1]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG os_brick.utils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] <== get_connector_properties: return (219ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updating existing volume attachment record: f237c8f3-44cc-4c22-b503-625581a12289 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lazy-loading 'flavor' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:42 user nova-compute[75051]: WARNING nova.compute.manager [req-ab5411a0-906f-4008-b8bf-a89dc0d59764 req-938722f5-26f7-4e74-addc-fda465870168 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b for instance with vm_state active and task_state None.
Nov 24 18:54:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] attach device xml: <disk type="block" device="disk">
Nov 24 18:54:42 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:42 user nova-compute[75051]:   <source dev="/dev/sdi"/>
Nov 24 18:54:42 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:42 user nova-compute[75051]:   <serial>522231b5-d7b1-4ad2-b620-67977be73080</serial>
Nov 24 18:54:42 user nova-compute[75051]: </disk>
Nov 24 18:54:42 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updated VIF entry in instance network info cache for port 5e5384ce-daff-46e4-bb67-d17297060d4b. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name hda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No VIF found with MAC fa:16:3e:6b:7b:1b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78902adb-c371-4f04-a941-5c648bce5c0a req-58146e22-b637-4d5a-bd18-a2bde99e5860 service nova] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:54:43 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:54:43</nova:creationTime>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:54:43 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:54:43 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:owner>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:54:43 user nova-compute[75051]:   </nova:owner>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:54:43 user nova-compute[75051]:   <nova:ports>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:54:43 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:54:43 user nova-compute[75051]:     </nova:port>
Nov 24 18:54:43 user nova-compute[75051]:     <nova:port uuid="5e5384ce-daff-46e4-bb67-d17297060d4b">
Nov 24 18:54:43 user nova-compute[75051]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 24 18:54:43 user nova-compute[75051]:     </nova:port>
Nov 24 18:54:43 user nova-compute[75051]:   </nova:ports>
Nov 24 18:54:43 user nova-compute[75051]: </nova:instance>
Nov 24 18:54:43 user nova-compute[75051]:  {{(pid=75051) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5483883d-dcb2-495d-a49a-153748fe1f63 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.106s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] No VIF found with MAC fa:16:3e:29:aa:8a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c28fc258-51eb-45df-81a4-49184127b782 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.193s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:43 user nova-compute[75051]: INFO nova.compute.manager [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Attaching volume 6bf002ba-8dfb-4d07-a5f1-47e9eddd085b to /dev/vdb
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.utils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be267c52-5507-4d4a-a4c7-ce5fe3f64ab6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[971dd695-1776-4826-87c9-a93cd02f05d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[280bb4b4-c595-4a80-90f7-049e9badca7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa48f15-4172-494d-b9bd-0f4dc21862ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:43 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25ccdf-cf46-4e75-8333-417067c52ccb]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG os_brick.utils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:43 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating existing volume attachment record: 887f40a2-fe38-4d28-9411-28f2fa0ff3a6 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:54:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:44 user nova-compute[75051]: WARNING nova.compute.manager [req-87d91f45-bae0-4dbd-995e-0fd9c9ccf687 req-1303a7c3-daa7-4efc-a5d6-32875ffa687d service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b for instance with vm_state active and task_state None.
Nov 24 18:54:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:45 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db9b6b6-116c-4aea-91c1-6e67f4e8cca1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:45 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4211bd0-870d-461d-867d-6d81b8c7a1fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53] added
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45486a0-0074-483a-b681-a56d313b1d75]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f404bcc-c41f-4a66-b6f0-47c4cb0341e1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOBXlrW {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOBXlrW" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45897e09-ecb4-47fa-8b89-e84e19c54b59]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjOBXlrW'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[91573673-59b2-486a-9eb5-8393a55d665d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c55d8e0-be99-4ba8-a06e-9c949b31f91b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f162f6a8-cdb0-48c2-a12c-20e1faded9fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]
Nov 24 18:54:45 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d9958-3e2a-4ba2-94c9-7820fd9316c8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2052ecb2-3522-472f-b436-d3aa609c18d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:45 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abdcf2f-85b8-4855-88cc-57111629256e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] volume_snapshot_create: create_info: {'snapshot_id': '5c267993-d727-4795-802c-4120a84647d2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75051) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] snap xml: <domainsnapshot>
Nov 24 18:54:46 user nova-compute[75051]:   <disks>
Nov 24 18:54:46 user nova-compute[75051]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 24 18:54:46 user nova-compute[75051]:       <source file="/dev/new_file"/>
Nov 24 18:54:46 user nova-compute[75051]:     </disk>
Nov 24 18:54:46 user nova-compute[75051]:     <disk name="vda" snapshot="no"/>
Nov 24 18:54:46 user nova-compute[75051]:   </disks>
Nov 24 18:54:46 user nova-compute[75051]: </domainsnapshot>
Nov 24 18:54:46 user nova-compute[75051]:  {{(pid=75051) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] Lazy-loading 'system_metadata' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-7976262e-1685-4aeb-9ef3-5d54ab2af9b4 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] volume_snapshot_delete: delete_info: {'volume_id': '522231b5-d7b1-4ad2-b620-67977be73080'} {{(pid=75051) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [None req-7976262e-1685-4aeb-9ef3-5d54ab2af9b4 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     if delete_info['type'] != 'qcow2':
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] KeyError: 'type'
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     rv = execute(f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     six.reraise(c, e, tb)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     raise value
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     rv = meth(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     self._volume_snapshot_create(context, instance, guest,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     rv = execute(f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     six.reraise(c, e, tb)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     raise value
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     rv = meth(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [None req-7976262e-1685-4aeb-9ef3-5d54ab2af9b4 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e6b1dfcf-4e06-4d8b-aba5-79b298a55460)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server [None req-7976262e-1685-4aeb-9ef3-5d54ab2af9b4 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] Exception during message handling: KeyError: 'type'
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 5c267993-d727-4795-802c-4120a84647d2 could not be found.
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise value
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 5c267993-d727-4795-802c-4120a84647d2 could not be found. (HTTP 404) (Request-ID: req-22bdcfb4-3a88-4f1c-a807-53523bcac5eb)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 5c267993-d727-4795-802c-4120a84647d2 could not be found.
Nov 24 18:54:46 user nova-compute[75051]: ERROR nova.virt.libvirt.driver 
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server [None req-e3ff4afb-080a-4bae-8d50-a74276413d98 tempest-VolumesAssistedSnapshotsTest-1551983053 tempest-VolumesAssistedSnapshotsTest-1551983053-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise value
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 24 18:54:46 user nova-compute[75051]: ERROR oslo_messaging.rpc.server 
Nov 24 18:54:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:46 user nova-compute[75051]: INFO nova.compute.manager [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Detaching volume 522231b5-d7b1-4ad2-b620-67977be73080
Nov 24 18:54:46 user nova-compute[75051]: INFO nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Rebuilding instance
Nov 24 18:54:46 user nova-compute[75051]: INFO nova.virt.block_device [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Attempting to driver detach volume 522231b5-d7b1-4ad2-b620-67977be73080 from mountpoint /dev/vdb
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Attempting to detach device vdb from instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:46 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:46 user nova-compute[75051]:   <source dev="/dev/sdi"/>
Nov 24 18:54:46 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:46 user nova-compute[75051]:   <serial>522231b5-d7b1-4ad2-b620-67977be73080</serial>
Nov 24 18:54:46 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:54:46 user nova-compute[75051]: </disk>
Nov 24 18:54:46 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Successfully detached device vdb from instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 from the persistent domain config.
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:46 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:46 user nova-compute[75051]:   <source dev="/dev/sdi"/>
Nov 24 18:54:46 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:46 user nova-compute[75051]:   <serial>522231b5-d7b1-4ad2-b620-67977be73080</serial>
Nov 24 18:54:46 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:54:46 user nova-compute[75051]: </disk>
Nov 24 18:54:46 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '26136353830323963', 'path': '/dev/sdj'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353830323963', 'path': '/dev/sdj'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-changed-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Refreshing instance network info cache due to event network-changed-cfff62d2-06f1-41c6-9394-7a02c1f328dc. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] Acquiring lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] Acquired lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Refreshing network info cache for port cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lazy-loading 'flavor' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:54:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:47 user nova-compute[75051]:   <source dev="/dev/sdj"/>
Nov 24 18:54:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:47 user nova-compute[75051]:   <serial>af63b8b8-762f-4c61-94cd-7d1407ae2f53</serial>
Nov 24 18:54:47 user nova-compute[75051]: </disk>
Nov 24 18:54:47 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:47 user nova-compute[75051]: WARNING nova.compute.manager [req-0d2e1824-e27b-4eb1-bf4f-6a6843e9dc21 req-dbb0909c-ece8-4b2c-abef-7316a840e075 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updated VIF entry in instance network info cache for port cfff62d2-06f1-41c6-9394-7a02c1f328dc. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating instance_info_cache with network_info: [{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:54:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81629f1c-a3c5-4fb0-a84b-9518e9840679 req-58e287e4-aea0-485a-8f45-06d24659df5c service nova] Releasing lock "refresh_cache-bec46576-e2b6-4bc9-8648-5cc341ac2144" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:54:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance destroyed successfully.
Nov 24 18:54:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance destroyed successfully.
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1692161129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:54:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfff62d2-06, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd131fd5-3ebf-4987-8d17-af8901236839) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: INFO os_vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06')
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] No VIF found with MAC fa:16:3e:70:1e:f0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:48 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e0c03b-d16c-47fe-af9e-e02781e1cd1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:54:48 user nova-compute[75051]: No targets found.
Nov 24 18:54:48 user nova-compute[75051]: iSNS:
Nov 24 18:54:48 user nova-compute[75051]: No targets found.
Nov 24 18:54:48 user nova-compute[75051]: STATIC:
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:54:48 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:48 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:48 user nova-compute[75051]: FIRMWARE:
Nov 24 18:54:48 user nova-compute[75051]: No targets found.
Nov 24 18:54:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:54:48 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:54:48 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a6623b-bfca-441f-8d28-00990b967683]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd3e89-779d-4291-a69f-150bf4d911e0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:48 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05a5900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5969585-edb4-462e-bbe7-a2b3dc11ba23]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa13745-d3e8-4f03-aa0a-e60795a5ed23]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3923821-8e80-458e-8b90-17be7f9f9ee4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d0ada-d732-4514-9f12-347df234df72]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c1c6e-68c5-4aac-86bb-3cabe550d369]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1dd429d4-6e18-46db-b2eb-560097f36894 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aa7e56-7a42-4041-9a22-788d814b1ade]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]
Nov 24 18:54:48 user nova-compute[75051]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[00639ba7-3755-47ca-82d8-a37a2a2fc295]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== disconnect_volume: return (427ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:54:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deleting instance files /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144_del
Nov 24 18:54:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deletion of /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144_del complete
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:48 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance bec46576-e2b6-4bc9-8648-5cc341ac2144 could not be found.
Nov 24 18:54:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:48 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d8d437-6496-4565-88d1-fc083c53091c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:54:49 user nova-compute[75051]: No targets found.
Nov 24 18:54:49 user nova-compute[75051]: iSNS:
Nov 24 18:54:49 user nova-compute[75051]: No targets found.
Nov 24 18:54:49 user nova-compute[75051]: STATIC:
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:54:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:54:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:54:49 user nova-compute[75051]: FIRMWARE:
Nov 24 18:54:49 user nova-compute[75051]: No targets found.
Nov 24 18:54:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:54:49 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:54:49 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5fa4b-4565-4912-91ce-e290cc38efc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25a96d8-a9f6-4ee2-9d54-1809abb31532]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:49 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05a6440>, {}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Disconnecting from: [] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.124s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== disconnect_volume: return (125ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:54:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1468d90c-3c64-4cbd-9be4-984c52c53339 req-e7735de0-80a6-4106-9af5-5a4025827108 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuilding.
Nov 24 18:54:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Preparing to wait for external event volume-reimaged-c846ce81-0890-47e5-bd84-76f6b1817724 {{(pid=75051) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKgrsaPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:50 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260" returned: 21 in 0.051s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a8dcd1-7bfa-4d9e-b180-78181cc90c94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3659594-af55-4953-ab98-f908f0588af0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22] added
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb879f04-c276-470e-ad4b-d1a45d8a6794]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.utils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c149a5-efcb-4eb8-b313-e3189d7bfa7c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b3c9ab-9689-4875-8edf-04bdf4043888]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKgrsaPJ {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b3721-c7a0-4f64-b6ac-af50228e1c06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LKgrsaPJ" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbec0e4-9167-476b-92e5-3c2f2eeb9070]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LKgrsaPJ'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9786d682-b794-4181-890d-c5defdc38204]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0559a9e9-520a-471f-99e0-a64e9fd10401]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7698ab-1a24-461f-b646-f9b18100a798]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:54:50 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb2b883-d785-4b62-a34f-7306f6046f8b]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.utils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e8f1ed-ab66-4e0f-a135-4a5ad25c1fe8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cad726-9075-4678-be73-01e644caaa48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260]
Nov 24 18:54:50 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: INFO nova.compute.manager [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Swapping volume af63b8b8-762f-4c61-94cd-7d1407ae2f53 for dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f0ac61-6ed3-4d2a-ab88-8acaa659f55c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46b461-4957-4e63-8042-ac27c74407e4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:50 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c922849-4d9f-4f05-a82a-bda2fe02104e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyGKPRmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:51 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKgrsaPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23831353532646666', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831353532646666', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.343s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:51 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:51 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lazy-loading 'flavor' on Instance uuid b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032a863-37d5-41ed-80a0-2c9a8e3412a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:51 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:54:51 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:51 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:54:51 user nova-compute[75051]:   <target dev="sdc" bus="scsi"/>
Nov 24 18:54:51 user nova-compute[75051]:   <serial>d5b649f9-bad0-4b34-9d2e-aac33a48cf22</serial>
Nov 24 18:54:51 user nova-compute[75051]:   <address type="drive" controller="0" unit="2"/>
Nov 24 18:54:51 user nova-compute[75051]: </disk>
Nov 24 18:54:51 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf0176-aafd-4dcc-a682-c3b0adbf3ad2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b] added
Nov 24 18:54:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3bac2-ec9c-4252-af5d-31359e3626cd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7845a5d-bb1b-4dfa-8cf4-d96962b2ae49]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyGKPRmW {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DyGKPRmW" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f11530-5f46-4d53-b1e5-2b677760461b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DyGKPRmW'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c287cf2a-739d-4eec-8376-c8e04df8b508]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e632ff-975e-4f50-a948-53e444d64f87]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:51 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[32744cac-4bef-4e51-9bc8-855ce9e06c6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260]
Nov 24 18:54:52 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:52 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cbf587-40f8-4e2d-90c7-06de4457685a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574d3a7-8055-4679-b08d-01d83443f84c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:52 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:52 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:52 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.082s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15d639b-cf54-4ec9-b8a1-d7c6349e8d52]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyGKPRmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No BDM found with device name sda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] No VIF found with MAC fa:16:3e:84:c5:ff, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf000bd1-5917-4a52-a3a0-abb92ca497a0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.043s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] <== connect_volume: return (1789ms) {'type': 'block', 'scsi_wwn': '26463636166346666', 'path': '/dev/sdk'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463636166346666', 'path': '/dev/sdk'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:54:53 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:53 user nova-compute[75051]:   <source dev="/dev/sdk"/>
Nov 24 18:54:53 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:53 user nova-compute[75051]:   <serial>6bf002ba-8dfb-4d07-a5f1-47e9eddd085b</serial>
Nov 24 18:54:53 user nova-compute[75051]: </disk>
Nov 24 18:54:53 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No BDM found with device name hda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] No VIF found with MAC fa:16:3e:6b:7b:1b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:54:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b3e7ff24-c936-48b6-9090-316c10436349 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.226s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:54:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:54 user nova-compute[75051]: INFO nova.compute.manager [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Detaching volume d5b649f9-bad0-4b34-9d2e-aac33a48cf22
Nov 24 18:54:54 user nova-compute[75051]: INFO nova.virt.block_device [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Attempting to driver detach volume d5b649f9-bad0-4b34-9d2e-aac33a48cf22 from mountpoint /dev/sdc
Nov 24 18:54:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Attempting to detach device sdc from instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:54:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:54 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:54 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:54:54 user nova-compute[75051]:   <target dev="sdc" bus="scsi"/>
Nov 24 18:54:54 user nova-compute[75051]:   <serial>d5b649f9-bad0-4b34-9d2e-aac33a48cf22</serial>
Nov 24 18:54:54 user nova-compute[75051]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 24 18:54:54 user nova-compute[75051]: </disk>
Nov 24 18:54:54 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Successfully detached device sdc from instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 from the persistent domain config.
Nov 24 18:54:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:54:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:54 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:54 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:54:54 user nova-compute[75051]:   <target dev="sdc" bus="scsi"/>
Nov 24 18:54:54 user nova-compute[75051]:   <serial>d5b649f9-bad0-4b34-9d2e-aac33a48cf22</serial>
Nov 24 18:54:54 user nova-compute[75051]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 24 18:54:54 user nova-compute[75051]: </disk>
Nov 24 18:54:54 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:54:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:54:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:54:55 user nova-compute[75051]: INFO nova.compute.manager [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Detaching volume 6bf002ba-8dfb-4d07-a5f1-47e9eddd085b
Nov 24 18:54:55 user nova-compute[75051]: INFO nova.virt.block_device [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Attempting to driver detach volume 6bf002ba-8dfb-4d07-a5f1-47e9eddd085b from mountpoint /dev/vdb
Nov 24 18:54:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Attempting to detach device vdb from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:54:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:55 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:55 user nova-compute[75051]:   <source dev="/dev/sdk"/>
Nov 24 18:54:55 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:55 user nova-compute[75051]:   <serial>6bf002ba-8dfb-4d07-a5f1-47e9eddd085b</serial>
Nov 24 18:54:55 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 18:54:55 user nova-compute[75051]: </disk>
Nov 24 18:54:55 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully detached device vdb from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the persistent domain config.
Nov 24 18:54:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:54:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:54:55 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:54:55 user nova-compute[75051]:   <source dev="/dev/sdk"/>
Nov 24 18:54:55 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:54:55 user nova-compute[75051]:   <serial>6bf002ba-8dfb-4d07-a5f1-47e9eddd085b</serial>
Nov 24 18:54:55 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 18:54:55 user nova-compute[75051]: </disk>
Nov 24 18:54:55 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:54:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:54:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'serial': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'serial'} {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:54:58 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:58 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:54:58 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e651f-33e9-4643-a042-0bec088a8d70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:54:58 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6efec3-b98c-4ccc-b721-90d3fc59f2b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5] added
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4d144-d3fc-4486-8a6c-b7a81ca5f4b0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da93d991-ff23-4d27-b340-8837b45d3542]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTgHNaDK {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dTgHNaDK" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da745304-e79b-4620-a906-9fe43ae085aa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dTgHNaDK'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a65a22b-426a-485e-9ed8-976dcb8e6b25]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0103ad3-bb55-40bd-92b4-ca4551984944]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c5f57-24c6-4a6e-93c6-adfb639e411d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260]
Nov 24 18:54:58 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260] successful.
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acad66-10ae-4d7e-89af-8d098ef7ad53]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58676d7-7ea1-4ab5-8e56-feac34fb189d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:54:58 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:54:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b08e8c0-73de-4051-adac-803cdc9f6a8c]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:54:58 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26531623665663365', 'path': '/dev/sdm'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531623665663365', 'path': '/dev/sdm'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lazy-loading 'flavor' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:54:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 5242880 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 320864256 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 514850816 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 612368384 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 858783744 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 948961280 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:55:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 1012924416 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:04 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ebfac-571b-445d-96d8-1f4034fa08bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:04 user nova-compute[75051]: No targets found.
Nov 24 18:55:04 user nova-compute[75051]: iSNS:
Nov 24 18:55:04 user nova-compute[75051]: No targets found.
Nov 24 18:55:04 user nova-compute[75051]: STATIC:
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:04 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:04 user nova-compute[75051]: No targets found.
Nov 24 18:55:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:04 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:04 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9ee41-4fb2-4d9f-ba09-1ddcd91f9d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd4009f-8754-4878-880c-3d56557cae46]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:04 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c023a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53'): ({'sdj'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Removing single pathed devices sdj {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1efaa1-6c87-4d68-b825-f41e8a43739e]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb6994b-172d-4362-be0c-f50544808fe7]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Flushing IO for device /dev/sdj {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c6c014-889a-42b3-8e41-1360903149af]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ca762a-b2b3-4bfd-881b-e4f8ea929783]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] SCSI volumes sdj have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c214970-3b63-4451-a535-d0ffd5d013c1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93df07df-20e3-4be8-97f2-ab3f6dae55c0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]
Nov 24 18:55:04 user nova-compute[75051]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26ac247-b49b-4fae-ab26-79094a69b891]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== disconnect_volume: return (357ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'serial'} {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 24 18:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: removing Cinder connection for volume af63b8b8-762f-4c61-94cd-7d1407ae2f53 {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: Updating volume af63b8b8-762f-4c61-94cd-7d1407ae2f53 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dTgHNaDK", "auth_password": "NU0hiwd2D9yY8V", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdm", "volume_id": "dda56a69-a15c-4916-b3c5-16ed74b79cf5"}, "status": "reserved", "instance": "f0410591-5d5c-473a-93a9-283730abc348", "attached_at": "", "detached_at": "", "volume_id": "dda56a69-a15c-4916-b3c5-16ed74b79cf5", "serial": "dda56a69-a15c-4916-b3c5-16ed74b79cf5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'no_device': None, 'attachment_id': '23f5cbc9-944a-4128-8f45-dd158247f263'} {{(pid=75051) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ff8dda5-bb22-4666-afca-56ecdfbe2c80 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.729s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-abf1da23-a742-4f77-9ff1-e78c2741dc1b req-6312b5d6-ef50-42a9-a19c-e791311b1788 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event volume-reimaged-c846ce81-0890-47e5-bd84-76f6b1817724 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-abf1da23-a742-4f77-9ff1-e78c2741dc1b req-6312b5d6-ef50-42a9-a19c-e791311b1788 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-abf1da23-a742-4f77-9ff1-e78c2741dc1b req-6312b5d6-ef50-42a9-a19c-e791311b1788 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-abf1da23-a742-4f77-9ff1-e78c2741dc1b req-6312b5d6-ef50-42a9-a19c-e791311b1788 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-abf1da23-a742-4f77-9ff1-e78c2741dc1b req-6312b5d6-ef50-42a9-a19c-e791311b1788 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Processing event volume-reimaged-c846ce81-0890-47e5-bd84-76f6b1817724 {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdm (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:07 user nova-compute[75051]: INFO nova.virt.block_device [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Booting with volume c846ce81-0890-47e5-bd84-76f6b1817724 at /dev/vda
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.utils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a094494b-c1bb-4506-8f20-9b9b19be5578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0b418-9dbb-4a01-be05-26c03e674a9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.utils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2e6a36-1a2a-487e-891a-bb95999ca53d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0013b8c6-4da9-4ff1-a9b4-b765d98643fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f133e49-89a9-4876-a2ea-254e5f3e335c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:55:07 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cf57c9-58ae-4933-bfe5-7b89a75293a5]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f7b92c-672d-4a1f-997a-6407d9d6bcb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.utils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc6fdcc-83ea-4a6e-9419-62a22190ca54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1e1b3c-3e25-4a08-a5a0-3cab22444d7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:55:07 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 is timed out.
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:55:07 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Successfully detached device vdb from instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 from the live domain config.
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjSnvRYJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:07 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:55:07 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47dc5ee-b642-41ef-bb78-0c96c8af170e]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.utils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating existing volume attachment record: 58f8020c-8d60-4bb9-a5c7-6d53942d7615 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: INFO nova.compute.manager [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Swapping volume dda56a69-a15c-4916-b3c5-16ed74b79cf5 for af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7076546-d824-4a54-8876-458822fde4b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:07 user nova-compute[75051]: No targets found.
Nov 24 18:55:07 user nova-compute[75051]: iSNS:
Nov 24 18:55:07 user nova-compute[75051]: No targets found.
Nov 24 18:55:07 user nova-compute[75051]: STATIC:
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:07 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:07 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:07 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:07 user nova-compute[75051]: No targets found.
Nov 24 18:55:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:07 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:07 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf353af-e190-4f24-88a2-c4de03aa0a6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00bfb1-514f-44fb-a2ac-aeb89329c900]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:07 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0383130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080'): ({'sdi'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Removing single pathed devices sdi {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dabbc4e-a0c1-415b-88b1-b963d605481c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3052fb5a-6e47-4eba-973a-49c97bb5060b]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Flushing IO for device /dev/sdi {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a0b0fe-0088-481a-aa85-4ccea0e4070c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11bfd57-34bc-4fff-acd4-23cc6c925586]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb300b4-c59b-4989-8421-d3c68108b505]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f29566-f4af-49b2-8a13-150ade5a55c3]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260]
Nov 24 18:55:07 user nova-compute[75051]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:07 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:522231b5-d7b1-4ad2-b620-67977be73080 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97683a8-cf23-419c-8653-2a9c88a2c3b9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] <== disconnect_volume: return (485ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lazy-loading 'flavor' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-changed-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing instance network info cache due to event network-changed-a5a438c0-7817-4d84-b3a9-c91f51a1d36c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] Acquiring lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] Acquired lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.network.neutron [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Refreshing network info cache for port a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:55:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:55:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7143MB free_disk=25.49850082397461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4d7889d-5981-4cc3-83d5-ba81b59ed632 tempest-VolumesAssistedSnapshotsTest-154559720 tempest-VolumesAssistedSnapshotsTest-154559720-project-admin] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.282s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e0d31370-4bdb-4804-b1d5-5e4a19a41912 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f0410591-5d5c-473a-93a9-283730abc348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bec46576-e2b6-4bc9-8648-5cc341ac2144 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 00a95e25-c59c-46f7-9aeb-d3f01146c189 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee44d98-b374-4d33-add8-d55fc15309cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:55:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-changed-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing instance network info cache due to event network-changed-f8031932-a2e0-4d12-9f38-04273d53b85a. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] Acquiring lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] Acquired lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Refreshing network info cache for port f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updated VIF entry in instance network info cache for port a5a438c0-7817-4d84-b3a9-c91f51a1d36c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a7b319c-1bb4-4358-903e-4763c397068b req-3bda1c36-3cb5-4967-a721-cfdb172501fd service nova] Releasing lock "refresh_cache-00a95e25-c59c-46f7-9aeb-d3f01146c189" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updated VIF entry in instance network info cache for port f8031932-a2e0-4d12-9f38-04273d53b85a. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0a0bbfa-b82a-4a22-8b06-5d45b7936c84 req-9ab7bc07-0080-4438-bf59-560d28ac375d service nova] Releasing lock "refresh_cache-e1ff9da6-e31d-49f6-a48f-56a2c4866686" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:11 user nova-compute[75051]: INFO nova.compute.manager [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Terminating instance
Nov 24 18:55:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-831aa9df-39d3-4e95-9ee3-d692233f8393 req-9d45e01d-6f13-4f73-91e0-ed6b38014d85 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-ba629722-f270-40f0-920c-0bf684e25d75 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:12 user nova-compute[75051]: INFO nova.compute.manager [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Terminating instance
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-45adb773-3dc0-408a-934d-bad91e9c881f req-ecb872ee-e73b-430d-aecf-40e02d9ff8fd service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-90253b7e-9ef4-49bc-b49b-87d0c4313f97 req-8202d142-11ad-43c9-9ca9-82c0759910e1 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-6a7b4267-a8c3-4237-ad90-884dee0e889c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Instance destroyed successfully.
Nov 24 18:55:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lazy-loading 'resources' on Instance uuid 00a95e25-c59c-46f7-9aeb-d3f01146c189 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5a438c0-78, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b34eba4d-9d48-45bb-a104-19f946a0f6b2) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:31:1b,bridge_name='br-int',has_traffic_filtering=True,id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c,network=Network(f0fea18c-9c3b-4006-9aa7-978c19b39954),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5a438c0-78')
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba629722-f2, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:14 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Instance destroyed successfully.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lazy-loading 'resources' on Instance uuid e1ff9da6-e31d-49f6-a48f-56a2c4866686 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-ba629722-f270-40f0-920c-0bf684e25d75 for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-1338870f-d540-4072-aa99-240541f1ccdc for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-1338870f-d540-4072-aa99-240541f1ccdc for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-86285a16-45ce-4fee-9115-d196637cccf3 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-81c166d2-c731-4a6b-bde0-0624b08f8519 req-0531dc8c-37c9-4748-85f3-a0932567daaf service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-86285a16-45ce-4fee-9115-d196637cccf3 for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8031932-a2, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 is timed out.
Nov 24 18:55:14 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Successfully detached device sdc from instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 from the live domain config.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LKgrsaPJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c78a4-3f2a-4c1f-9d4b-edbe8124c31e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:14 user nova-compute[75051]: No targets found.
Nov 24 18:55:14 user nova-compute[75051]: iSNS:
Nov 24 18:55:14 user nova-compute[75051]: No targets found.
Nov 24 18:55:14 user nova-compute[75051]: STATIC:
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:14 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:14 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:14 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:14 user nova-compute[75051]: No targets found.
Nov 24 18:55:14 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:14 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:14 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9994bfca-2eb9-4dd2-8e25-31ec571318c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2889a3-c308-4b68-8119-9836431375a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:14 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:14 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:14 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c04ee170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d8a6a-ea72-4177-aaef-b9b1d05086b7]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e34ab7-ca08-44c0-a47a-02e2f3f1277c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6a3c5b-8175-4e93-9cf5-9307fef9e253]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e5286e8-4110-4491-896e-08c190591ef6) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201213a-7315-4347-a5ed-6492453fa069]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbeaf3c-d7ca-498b-b541-dc7e96ac839d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-a5a438c0-7817-4d84-b3a9-c91f51a1d36c for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-unplugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-unplugged-53ad060d-cc1f-4417-9732-27af3a1b8589 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: WARNING nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-53ad060d-cc1f-4417-9732-27af3a1b8589 for instance with vm_state active and task_state deleting.
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-6726eec6-28d6-4cb5-b389-5fdab9e782d2 req-5ea63095-97dd-44e4-87c0-b33320aa0cac service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-b1010f31-a7d7-4156-9113-a02ab3de36df for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Acquiring lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] No waiting events found dispatching network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:15 user nova-compute[75051]: WARNING nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received unexpected event network-vif-plugged-6a7b4267-a8c3-4237-ad90-884dee0e889c for instance with vm_state active and task_state deleting.
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:15 user nova-compute[75051]: WARNING nova.compute.manager [req-663ccee9-24a1-42d1-a1c1-a9ad523823f8 req-693ce567-0822-4de8-bb3c-ec461a9af521 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a for instance with vm_state active and task_state deleting.
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7f40ca-9ea4-4c65-9886-9edb7be2d5e3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260]
Nov 24 18:55:15 user nova-compute[75051]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5b649f9-bad0-4b34-9d2e-aac33a48cf22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00baf98-bf39-4870-952e-c240a64fe905]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] <== disconnect_volume: return (460ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6dee885-e4c1-4eb0-a04d-babfe0095a8e) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:15 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:9c:43,bridge_name='br-int',has_traffic_filtering=True,id=ba629722-f270-40f0-920c-0bf684e25d75,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba629722-f2')
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1338870f-d5, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:15 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e2:a6,bridge_name='br-int',has_traffic_filtering=True,id=f8031932-a2e0-4d12-9f38-04273d53b85a,network=Network(e7a4f1f3-dc42-4251-92e2-9007e9d6d956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8031932-a2')
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1010f31-a7, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=937913db-ab9c-4013-b456-7dcb9afb6eba) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lazy-loading 'flavor' on Instance uuid b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'serial': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5'}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'serial'} {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe289b33-1fb6-424e-bcf6-e1d1736ee493) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:15 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7b:ed,bridge_name='br-int',has_traffic_filtering=True,id=1338870f-d540-4072-aa99-240541f1ccdc,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1338870f-d5')
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65873d54-7e72-49b4-839a-81dea11a5fb0 tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[07611974-977d-427f-aba7-5126367385d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:55:16 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b3c95c-164f-4f39-9b64-2e80c78c98bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd is timed out.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53] added
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully detached device vdb from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the live domain config.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23b4241b-6f, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DyGKPRmW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:44:4f,bridge_name='br-int',has_traffic_filtering=True,id=b1010f31-a7d7-4156-9113-a02ab3de36df,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb1010f31-a7')
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68026a26-c0b5-4d95-8f3d-790c7661c1c3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5633a8-8407-4e49-9463-e293db3b3de1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOBXlrW {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xjOBXlrW" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7347616-ddaa-4c89-8589-55d977c421eb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xjOBXlrW'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:55:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Creating image(s)
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Ensure instance console log exists: /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start _get_guest_xml network_info=[{"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bec46576-e2b6-4bc9-8648-5cc341ac2144', 'attached_at': '', 'detached_at': '', 'volume_id': 'c846ce81-0890-47e5-bd84-76f6b1817724', 'serial': 'c846ce81-0890-47e5-bd84-76f6b1817724'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '58f8020c-8d60-4bb9-a5c7-6d53942d7615', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb63620-5686-4a89-abe7-20d11aee93db]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1482f34a-9d, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lazy-loading 'vcpu_model' on Instance uuid bec46576-e2b6-4bc9-8648-5cc341ac2144 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfb4cb1-63ca-4e83-a1d1-2dfaf4cf877c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0861688c-e93d-4fec-bcd2-9dbea29123f9) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[337cd72a-2ebf-48f2-94b0-e1170f8d13d7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]
Nov 24 18:55:16 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6983c6-99c2-4fc3-8d99-00ae8cef7041]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6dcde99-486a-4197-b45b-bbf2be5f7822) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:58,bridge_name='br-int',has_traffic_filtering=True,id=23b4241b-6f88-481e-bd3e-bfa0c91f2ec9,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23b4241b-6f')
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677202b-deb9-477d-8150-7f312018b632]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:16 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:16 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6682f-1459-4024-aba8-b7dce353a0cb]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: INFO nova.compute.manager [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Terminating instance
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86285a16-45, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:8a,bridge_name='br-int',has_traffic_filtering=True,id=1482f34a-9d12-434c-9eb9-cef34a221e9d,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1482f34a-9d')
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-f8031932-a2e0-4d12-9f38-04273d53b85a for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-f8031932-a2e0-4d12-9f38-04273d53b85a for instance with vm_state active and task_state deleting.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-1482f34a-9d12-434c-9eb9-cef34a221e9d for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-1482f34a-9d12-434c-9eb9-cef34a221e9d for instance with vm_state active and task_state deleting.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 for instance with vm_state active and task_state deleting.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:16 user nova-compute[75051]: WARNING nova.compute.manager [req-077b767e-e481-4b9b-b865-a780878bf89a req-135f6147-b186-4938-9882-be6a08a296fb service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-5aa616a3-c72a-46a9-874e-ea0ba316edfa for instance with vm_state active and task_state deleting.
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea999b70-6d, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb8062bc-fdb0-4e05-9e87-1e574833aa56) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dd04805-e6d6-4d3e-a4dc-8ee9856e3dbe) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8e:13,bridge_name='br-int',has_traffic_filtering=True,id=86285a16-45ce-4fee-9115-d196637cccf3,network=Network(41b0cea8-6c83-4c78-b5dd-9f318a898cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86285a16-45')
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "address": "fa:16:3e:0d:c0:05", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a7b4267-a8", "ovs_interfaceid": "6a7b4267-a8c3-4237-ad90-884dee0e889c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a7b4267-a8, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:4c:d4,bridge_name='br-int',has_traffic_filtering=True,id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea999b70-6d')
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8e5ee6-9b, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-b1010f31-a7d7-4156-9113-a02ab3de36df for instance with vm_state active and task_state deleting.
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-unplugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-unplugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Acquiring lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] No waiting events found dispatching network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING nova.compute.manager [req-a9cd234c-7632-488c-8585-9b996b8869fc req-343f1c98-e9a3-4885-b38f-d09f98a7262e service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received unexpected event network-vif-plugged-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 for instance with vm_state active and task_state deleting.
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6abb7af8-5225-46d7-b01a-ca66dd354000) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-unplugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] No waiting events found dispatching network-vif-unplugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-unplugged-023e6dbb-607c-4da2-a30a-757bd15faca9 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Acquiring lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] No waiting events found dispatching network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING nova.compute.manager [req-4cd9b434-939c-4342-865d-54fa406ecd77 req-5dd18233-b80d-4e8c-83b5-81f4a40b43b3 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received unexpected event network-vif-plugged-023e6dbb-607c-4da2-a30a-757bd15faca9 for instance with vm_state active and task_state deleting.
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=503b58ea-ae78-4842-80e1-1b59d7e394b9) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:c0:05,bridge_name='br-int',has_traffic_filtering=True,id=6a7b4267-a8c3-4237-ad90-884dee0e889c,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a7b4267-a8')
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-510949010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-510949010',id=10,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOP7RktPZgDU//gkPVDrfOD87ESVJ66T2y/gAcuhZ1EjwagjWkn6uPMKC8hMGY8GtosvQ+Av+G/KR3cwtvop9ztrJHbPZhAHBYFCB8nNX6srdfnik60YQajnz4F05Nv5SQ==',key_name='tempest-keypair-1020424617',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dea95244ac640c59516fbcda9f1e028',ramdisk_id='',reservation_id='r-wg4hujyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-198222194',owner_user_name='tempest-TaggedBootDevicesTest-198222194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f61bed5ee29e4282acf077e10b140e97',uuid=00a95e25-c59c-46f7-9aeb-d3f01146c189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converting VIF {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ad060d-cc, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:ca:6a,bridge_name='br-int',has_traffic_filtering=True,id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574,network=Network(f7937961-1c75-4ecd-ad1f-36a616fccbc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e5ee6-9b')
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "address": "fa:16:3e:52:c4:5d", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9d6ec78-0e", "ovs_interfaceid": "a9d6ec78-0eee-4f7f-bdeb-7232556cc90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Instance destroyed successfully.
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.objects.instance [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lazy-loading 'resources' on Instance uuid b9dd0e67-88e8-4b07-98ba-04fb21fa87f5 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-286853329',display_name='tempest-AttachSCSIVolumeTestJSON-server-286853329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-286853329',id=7,image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEr9OaqyNecGuqJiGaOVs7+DnMMboPelFq37h0hVdUzV+tFmLN2SjTXxQIDPJPIrwyPWX+8fILR1e6cdCrk7N3gG9MXrhAOW3NTqY74Nr1TKZZTt+gwqTvNDuiLQkT7Uw==',key_name='tempest-keypair-183800523',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86489e5f33d24e35bff96a224cc4c778',ramdisk_id='',reservation_id='r-o6y7q6s7',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e8ea8490-0a56-4692-bcd3-bf4396265d41',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1592601763',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1592601763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecfb56e8f1ba48fc9a5d2d454a9d71c4',uuid=b9dd0e67-88e8-4b07-98ba-04fb21fa87f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converting VIF {"id": "023e6dbb-607c-4da2-a30a-757bd15faca9", "address": "fa:16:3e:84:c5:ff", "network": {"id": "4d888b6b-fde9-4dc8-9d40-36131bee2dcd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-575778964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86489e5f33d24e35bff96a224cc4c778", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023e6dbb-60", "ovs_interfaceid": "023e6dbb-607c-4da2-a30a-757bd15faca9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_vif [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9d6ec78-0e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap023e6dbb-60, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a17ffbb1-185b-4c64-be23-e4bff6f68e66) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c0a75f8-3d89-4e67-ab5d-a39b1a83a2e8) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:0d:ea,bridge_name='br-int',has_traffic_filtering=True,id=53ad060d-cc1f-4417-9732-27af3a1b8589,network=Network(8d6ecb3c-0d13-40b8-b03b-bab271721322),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ad060d-cc')
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYhTcJis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d42ad600-5cfb-4524-b98b-7f707f511a9c) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:c4:5d,bridge_name='br-int',has_traffic_filtering=True,id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9d6ec78-0e')
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1093516138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1093516138',id=11,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOM+icWa2BxGIM6OkBRKH7WoA6EDf+J7gT/2MfgG79LWsqSC+cYNnAbz9eHdtHiA3G+AA2A5JrLDkyaUWUpfCrrHKdsIGFAAEmUlXCBzXBngRyEeqfuFYxoHyU/KDGXyzw==',key_name='tempest-keypair-1355884250',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37c20b6ddd74260b6b62417476cdc7d',ramdisk_id='',reservation_id='r-athq230j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-300268766',owner_user_name='tempest-TaggedBootDevicesTest_v242-300268766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92c75efaae44fc0a39baef226105b86',uuid=e1ff9da6-e31d-49f6-a48f-56a2c4866686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converting VIF {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aa616a3-c7, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:c5:ff,bridge_name='br-int',has_traffic_filtering=True,id=023e6dbb-607c-4da2-a30a-757bd15faca9,network=Network(4d888b6b-fde9-4dc8-9d40-36131bee2dcd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023e6dbb-60')
Nov 24 18:55:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Deleting instance files /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5_del
Nov 24 18:55:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Deletion of /opt/stack/data/nova/instances/b9dd0e67-88e8-4b07-98ba-04fb21fa87f5_del complete
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63d89c07-a50f-4377-a7bb-ae958437d39a) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_vif [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:9a:1a,bridge_name='br-int',has_traffic_filtering=True,id=5aa616a3-c72a-46a9-874e-ea0ba316edfa,network=Network(08a8b4a5-7529-4f85-87bc-e84a411d7840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aa616a3-c7')
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZIpfcxiq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:17 user nova-compute[75051]: INFO nova.compute.manager [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '26136353830323963', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136353830323963', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.344s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lazy-loading 'flavor' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a9987d-b5fc-4a6e-9922-850d45a9a698]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:17 user nova-compute[75051]: No targets found.
Nov 24 18:55:17 user nova-compute[75051]: iSNS:
Nov 24 18:55:17 user nova-compute[75051]: No targets found.
Nov 24 18:55:17 user nova-compute[75051]: STATIC:
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:17 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:17 user nova-compute[75051]: No targets found.
Nov 24 18:55:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:17 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:17 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f532c30b-8e2f-41f4-81fe-055d8338dcd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f6619-d53a-4810-9b1a-4b8cfa12362d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:17 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0424f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b'): ({'sdk'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Removing single pathed devices sdk {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c8944-1301-4a9f-bffb-2d3fe10c4c48]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ee4bb6-4914-47c2-beb0-139345f82c88]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Flushing IO for device /dev/sdk {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[716b4ed4-6aab-4759-9baf-67b542f6557d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83837524-6af1-4866-a7f0-651a4aa7cd06]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] SCSI volumes sdk have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c178b49-40df-40b9-a0f0-0cc5231bf15e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc2e38-7b83-470e-b23b-fc52b2861c78]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260]
Nov 24 18:55:17 user nova-compute[75051]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bf002ba-8dfb-4d07-a5f1-47e9eddd085b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ec413-a1ba-4639-9c79-a42dfe9d9ca0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] <== disconnect_volume: return (1730ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.567s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:17 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:17 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d899af6-2f5e-431e-8def-89c1195333d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:55:17 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f180265f-2e1c-423d-bc23-91fc68078939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724] added
Nov 24 18:55:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a204b3-2e77-4a75-9275-a9f6072078ec]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a9e26-2132-4a2f-a16a-54d9541974cf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDcxQVvm {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDcxQVvm" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0c5b6-24a4-488b-aef4-c3ca0a95ec61]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDcxQVvm'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c97b9d0-1b8c-4b72-a5dd-76175ba1ccce]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6dca1-b35e-433f-9a5d-77ed0450895b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d841627c-cf44-496a-a555-a12d7d2cdb8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]
Nov 24 18:55:18 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a05a6-ef57-4a52-9bef-5548b23ba44a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b492b55f-a206-4be5-83e8-c58b0f60ec36]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:18 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.439s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] HCTL ('40', '-', '-', 0) found on session 17 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b910db-2649-4e1f-959d-acc6ab439056]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching for a device in session 17 and hctl ['40', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:18 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Took 1.27 seconds to deallocate network for instance.
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 295698432 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-bc5d6307-316b-411c-a06a-f264f2cec11a req-eeb135ac-9744-4b9d-802a-bbd6a2731ee1 service nova] [instance: b9dd0e67-88e8-4b07-98ba-04fb21fa87f5] Received event network-vif-deleted-023e6dbb-607c-4da2-a30a-757bd15faca9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Searching for a device in session 17 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '23531363531633738', 'path': '/dev/sdi'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531363531633738', 'path': '/dev/sdi'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff57dee0-a9fe-42d2-b59d-97d24d18da41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:19 user nova-compute[75051]: No targets found.
Nov 24 18:55:19 user nova-compute[75051]: iSNS:
Nov 24 18:55:19 user nova-compute[75051]: No targets found.
Nov 24 18:55:19 user nova-compute[75051]: STATIC:
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:19 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:19 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:19 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:19 user nova-compute[75051]: No targets found.
Nov 24 18:55:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:19 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:19 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1692161129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:55:19 user nova-compute[75051]:   <uuid>bec46576-e2b6-4bc9-8648-5cc341ac2144</uuid>
Nov 24 18:55:19 user nova-compute[75051]:   <name>instance-00000009</name>
Nov 24 18:55:19 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:55:19 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:55:19 user nova-compute[75051]:   <metadata>
Nov 24 18:55:19 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:19 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:55:19 user nova-compute[75051]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1692161129</nova:name>
Nov 24 18:55:19 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:55:16</nova:creationTime>
Nov 24 18:55:19 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:55:19 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:19 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:55:19 user nova-compute[75051]:       <nova:owner>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:user uuid="7c302b95e8c240f78684448f37d317e2">tempest-ServerActionsV293TestJSON-114400367-project-member</nova:user>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:project uuid="cc9f240a45c840cb9715c2c608250d9f">tempest-ServerActionsV293TestJSON-114400367</nova:project>
Nov 24 18:55:19 user nova-compute[75051]:       </nova:owner>
Nov 24 18:55:19 user nova-compute[75051]:       <nova:ports>
Nov 24 18:55:19 user nova-compute[75051]:         <nova:port uuid="cfff62d2-06f1-41c6-9394-7a02c1f328dc">
Nov 24 18:55:19 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 18:55:19 user nova-compute[75051]:         </nova:port>
Nov 24 18:55:19 user nova-compute[75051]:       </nova:ports>
Nov 24 18:55:19 user nova-compute[75051]:     </nova:instance>
Nov 24 18:55:19 user nova-compute[75051]:   </metadata>
Nov 24 18:55:19 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:55:19 user nova-compute[75051]:     <system>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="serial">bec46576-e2b6-4bc9-8648-5cc341ac2144</entry>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="uuid">bec46576-e2b6-4bc9-8648-5cc341ac2144</entry>
Nov 24 18:55:19 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:55:19 user nova-compute[75051]:     </system>
Nov 24 18:55:19 user nova-compute[75051]:   </sysinfo>
Nov 24 18:55:19 user nova-compute[75051]:   <os>
Nov 24 18:55:19 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:55:19 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:55:19 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:55:19 user nova-compute[75051]:   </os>
Nov 24 18:55:19 user nova-compute[75051]:   <features>
Nov 24 18:55:19 user nova-compute[75051]:     <acpi/>
Nov 24 18:55:19 user nova-compute[75051]:     <apic/>
Nov 24 18:55:19 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:55:19 user nova-compute[75051]:   </features>
Nov 24 18:55:19 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:55:19 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:55:19 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:55:19 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:55:19 user nova-compute[75051]:   </clock>
Nov 24 18:55:19 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:55:19 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:55:19 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:55:19 user nova-compute[75051]:   </cpu>
Nov 24 18:55:19 user nova-compute[75051]:   <devices>
Nov 24 18:55:19 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:55:19 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:55:19 user nova-compute[75051]:       <source dev="/dev/sdi"/>
Nov 24 18:55:19 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:55:19 user nova-compute[75051]:       <serial>c846ce81-0890-47e5-bd84-76f6b1817724</serial>
Nov 24 18:55:19 user nova-compute[75051]:     </disk>
Nov 24 18:55:19 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:55:19 user nova-compute[75051]:       <mac address="fa:16:3e:6b:7c:d2"/>
Nov 24 18:55:19 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:55:19 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:55:19 user nova-compute[75051]:       <target dev="tapcfff62d2-06"/>
Nov 24 18:55:19 user nova-compute[75051]:     </interface>
Nov 24 18:55:19 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:55:19 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144/console.log" append="off"/>
Nov 24 18:55:19 user nova-compute[75051]:     </serial>
Nov 24 18:55:19 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:55:19 user nova-compute[75051]:     <video>
Nov 24 18:55:19 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:55:19 user nova-compute[75051]:     </video>
Nov 24 18:55:19 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:55:19 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:55:19 user nova-compute[75051]:     </rng>
Nov 24 18:55:19 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:55:19 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:55:19 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:55:19 user nova-compute[75051]:     </memballoon>
Nov 24 18:55:19 user nova-compute[75051]:   </devices>
Nov 24 18:55:19 user nova-compute[75051]: </domain>
Nov 24 18:55:19 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1692161129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '382431a4-d32c-5a34-9eb3-f4f80b84cc1e', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.583s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f24d918-7889-4540-bcfe-73a003e6b2c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 445644800 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1f16862-69bf-40da-969d-44cb5187e543 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.998s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.071s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[472aaa81-291c-44e0-8b26-31347b44eb96]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:19 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05980d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7'): ({'sdf'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Removing single pathed devices sdf {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:19 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Deleted allocations for instance b9dd0e67-88e8-4b07-98ba-04fb21fa87f5
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5416cfe-fc31-46be-b722-8cffe363f2a5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4118f716-67f7-4e06-a9ee-5acc776af18e]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Flushing IO for device /dev/sdf {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfff62d2-06, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfff62d2-06, col_values=(('qos', UUID('cc7b8183-fcdc-43d1-9834-7b3d9fe68c94')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfff62d2-06, col_values=(('external_ids', {'iface-id': 'cfff62d2-06f1-41c6-9394-7a02c1f328dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7c:d2', 'vm-uuid': 'bec46576-e2b6-4bc9-8648-5cc341ac2144'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93f4d2-522f-4b1b-ae71-b5b6725cecf6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:19 user nova-compute[75051]: INFO os_vif [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06')
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.195s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[676638f6-cfa1-4a29-bb21-7bc03e10146f]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] SCSI volumes sdf have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51f53c-38ad-436a-8eab-91cce1f34cb0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-37196cdd-f50a-4617-bf1a-216798cda8ed tempest-AttachSCSIVolumeTestJSON-1592601763 tempest-AttachSCSIVolumeTestJSON-1592601763-project-member] Lock "b9dd0e67-88e8-4b07-98ba-04fb21fa87f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.467s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] No VIF found with MAC fa:16:3e:6b:7c:d2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 571473920 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c374c1-08ef-4951-8cb8-9d423a27fe29]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260]
Nov 24 18:55:19 user nova-compute[75051]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e6ec4e5-b335-495e-adf3-d1cdbd9944c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[02372bf0-4ee6-4e60-bb13-87b267a545f4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.709s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== disconnect_volume: return (2715ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.665s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OPyFTihg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671643b-7fa9-4149-8de3-110a1fbdd3db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: iSNS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: STATIC:
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:20 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cb9725-562e-4ceb-ae0f-a6de08b58fa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b58b782-106a-4e60-bd2b-132c80306348]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0427640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8'): ({'sdg'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Removing single pathed devices sdg {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d013fa0-da96-4b55-bf85-dcdf5d6e10da]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc90bb6-89a2-4d54-9f6e-c9c7b35b8174]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Flushing IO for device /dev/sdg {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e217135d-e4f1-47d5-b483-78ec8896c574]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f16b9-4108-4d98-bf1b-d9f2c193a8ff]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] SCSI volumes sdg have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95daa6e5-f2a5-47fa-9289-692c2cca95e3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.136s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa6ec2-dd21-4e39-9a17-75a6080c0047]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260]
Nov 24 18:55:20 user nova-compute[75051]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 664797184 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70fdb9f1-0a2a-4cad-8a03-49cafea6c0f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b1a257-0656-4ae6-83e8-a7af251368ac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== disconnect_volume: return (3108ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.438s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUakvwXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e71ac0d-3bd7-40dd-aff2-1e582d5fa962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: iSNS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: STATIC:
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:20 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf2050-1e1c-414e-ad27-106691fed4b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d126e935-5716-434e-85fb-530d8133a79d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:20 user nova-compute[75051]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a (non-flash)
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0427760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a'): ({'sdh'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Removing single pathed devices sdh {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-5e5384ce-daff-46e4-bb67-d17297060d4b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-5e5384ce-daff-46e4-bb67-d17297060d4b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd3244d-8bcb-444c-a281-c77303171907]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc97009-c337-4dd9-ae87-9210487f3ec4]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Flushing IO for device /dev/sdh {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0331c9-dfb5-463e-adbe-b9bd3c4b3b90]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Attempting to detach device tap5e5384ce-da from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] detach device xml: <interface type="ethernet">
Nov 24 18:55:20 user nova-compute[75051]:   <mac address="fa:16:3e:70:c0:bf"/>
Nov 24 18:55:20 user nova-compute[75051]:   <model type="virtio"/>
Nov 24 18:55:20 user nova-compute[75051]:   <mtu size="1442"/>
Nov 24 18:55:20 user nova-compute[75051]:   <target dev="tap5e5384ce-da"/>
Nov 24 18:55:20 user nova-compute[75051]: </interface>
Nov 24 18:55:20 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 18:55:20 user nova-compute[75051]:   <name>instance-00000008</name>
Nov 24 18:55:20 user nova-compute[75051]:   <uuid>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</uuid>
Nov 24 18:55:20 user nova-compute[75051]:   <metadata>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:20 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:54:43</nova:creationTime>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:20 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:20 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:20 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:20 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:20 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:20 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:20 user nova-compute[75051]:     <nova:port uuid="5e5384ce-daff-46e4-bb67-d17297060d4b">
Nov 24 18:55:20 user nova-compute[75051]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 24 18:55:20 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:20 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:20 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:20 user nova-compute[75051]:   </metadata>
Nov 24 18:55:20 user nova-compute[75051]:   <memory unit='KiB'>524288</memory>
Nov 24 18:55:20 user nova-compute[75051]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 18:55:20 user nova-compute[75051]:   <vcpu placement='static'>1</vcpu>
Nov 24 18:55:20 user nova-compute[75051]:   <resource>
Nov 24 18:55:20 user nova-compute[75051]:     <partition>/machine</partition>
Nov 24 18:55:20 user nova-compute[75051]:   </resource>
Nov 24 18:55:20 user nova-compute[75051]:   <sysinfo type='smbios'>
Nov 24 18:55:20 user nova-compute[75051]:     <system>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='version'>0.0.0</entry>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='serial'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='uuid'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:20 user nova-compute[75051]:       <entry name='family'>Virtual Machine</entry>
Nov 24 18:55:20 user nova-compute[75051]:     </system>
Nov 24 18:55:20 user nova-compute[75051]:   </sysinfo>
Nov 24 18:55:20 user nova-compute[75051]:   <os>
Nov 24 18:55:20 user nova-compute[75051]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 18:55:20 user nova-compute[75051]:     <boot dev='hd'/>
Nov 24 18:55:20 user nova-compute[75051]:     <smbios mode='sysinfo'/>
Nov 24 18:55:20 user nova-compute[75051]:   </os>
Nov 24 18:55:20 user nova-compute[75051]:   <features>
Nov 24 18:55:20 user nova-compute[75051]:     <acpi/>
Nov 24 18:55:20 user nova-compute[75051]:     <apic/>
Nov 24 18:55:20 user nova-compute[75051]:     <vmcoreinfo state='on'/>
Nov 24 18:55:20 user nova-compute[75051]:   </features>
Nov 24 18:55:20 user nova-compute[75051]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 18:55:20 user nova-compute[75051]:     <model fallback='forbid'>Nehalem</model>
Nov 24 18:55:20 user nova-compute[75051]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 18:55:20 user nova-compute[75051]:     <feature policy='require' name='vme'/>
Nov 24 18:55:20 user nova-compute[75051]:     <feature policy='require' name='x2apic'/>
Nov 24 18:55:20 user nova-compute[75051]:     <feature policy='require' name='hypervisor'/>
Nov 24 18:55:20 user nova-compute[75051]:   </cpu>
Nov 24 18:55:20 user nova-compute[75051]:   <clock offset='utc'>
Nov 24 18:55:20 user nova-compute[75051]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 18:55:20 user nova-compute[75051]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 18:55:20 user nova-compute[75051]:     <timer name='hpet' present='no'/>
Nov 24 18:55:20 user nova-compute[75051]:   </clock>
Nov 24 18:55:20 user nova-compute[75051]:   <on_poweroff>destroy</on_poweroff>
Nov 24 18:55:20 user nova-compute[75051]:   <on_reboot>restart</on_reboot>
Nov 24 18:55:20 user nova-compute[75051]:   <on_crash>destroy</on_crash>
Nov 24 18:55:20 user nova-compute[75051]:   <devices>
Nov 24 18:55:20 user nova-compute[75051]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 18:55:20 user nova-compute[75051]:     <disk type='file' device='disk'>
Nov 24 18:55:20 user nova-compute[75051]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 18:55:20 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk' index='2'/>
Nov 24 18:55:20 user nova-compute[75051]:       <backingStore type='file' index='3'>
Nov 24 18:55:20 user nova-compute[75051]:         <format type='raw'/>
Nov 24 18:55:20 user nova-compute[75051]:         <source file='/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451'/>
Nov 24 18:55:20 user nova-compute[75051]:         <backingStore/>
Nov 24 18:55:20 user nova-compute[75051]:       </backingStore>
Nov 24 18:55:20 user nova-compute[75051]:       <target dev='vda' bus='virtio'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='virtio-disk0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </disk>
Nov 24 18:55:20 user nova-compute[75051]:     <disk type='file' device='cdrom'>
Nov 24 18:55:20 user nova-compute[75051]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 18:55:20 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config' index='1'/>
Nov 24 18:55:20 user nova-compute[75051]:       <backingStore/>
Nov 24 18:55:20 user nova-compute[75051]:       <target dev='hda' bus='ide'/>
Nov 24 18:55:20 user nova-compute[75051]:       <readonly/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='ide0-0-0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </disk>
Nov 24 18:55:20 user nova-compute[75051]:     <controller type='usb' index='0' model='none'>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='usb'/>
Nov 24 18:55:20 user nova-compute[75051]:     </controller>
Nov 24 18:55:20 user nova-compute[75051]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='pci.0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </controller>
Nov 24 18:55:20 user nova-compute[75051]:     <controller type='ide' index='0'>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='ide'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 18:55:20 user nova-compute[75051]:     </controller>
Nov 24 18:55:20 user nova-compute[75051]:     <interface type='ethernet'>
Nov 24 18:55:20 user nova-compute[75051]:       <mac address='fa:16:3e:6b:7b:1b'/>
Nov 24 18:55:20 user nova-compute[75051]:       <target dev='tap100a87c1-4a'/>
Nov 24 18:55:20 user nova-compute[75051]:       <model type='virtio'/>
Nov 24 18:55:20 user nova-compute[75051]:       <mtu size='1442'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='net0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </interface>
Nov 24 18:55:20 user nova-compute[75051]:     <interface type='ethernet'>
Nov 24 18:55:20 user nova-compute[75051]:       <mac address='fa:16:3e:70:c0:bf'/>
Nov 24 18:55:20 user nova-compute[75051]:       <target dev='tap5e5384ce-da'/>
Nov 24 18:55:20 user nova-compute[75051]:       <model type='virtio'/>
Nov 24 18:55:20 user nova-compute[75051]:       <mtu size='1442'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='net1'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </interface>
Nov 24 18:55:20 user nova-compute[75051]:     <serial type='pty'>
Nov 24 18:55:20 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:20 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:20 user nova-compute[75051]:       <target type='isa-serial' port='0'>
Nov 24 18:55:20 user nova-compute[75051]:         <model name='isa-serial'/>
Nov 24 18:55:20 user nova-compute[75051]:       </target>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </serial>
Nov 24 18:55:20 user nova-compute[75051]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 18:55:20 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:20 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:20 user nova-compute[75051]:       <target type='serial' port='0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </console>
Nov 24 18:55:20 user nova-compute[75051]:     <input type='mouse' bus='ps2'>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='input0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </input>
Nov 24 18:55:20 user nova-compute[75051]:     <input type='keyboard' bus='ps2'>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='input1'/>
Nov 24 18:55:20 user nova-compute[75051]:     </input>
Nov 24 18:55:20 user nova-compute[75051]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 18:55:20 user nova-compute[75051]:       <listen type='address' address='0.0.0.0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </graphics>
Nov 24 18:55:20 user nova-compute[75051]:     <audio id='1' type='none'/>
Nov 24 18:55:20 user nova-compute[75051]:     <video>
Nov 24 18:55:20 user nova-compute[75051]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='video0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </video>
Nov 24 18:55:20 user nova-compute[75051]:     <memballoon model='virtio'>
Nov 24 18:55:20 user nova-compute[75051]:       <stats period='10'/>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='balloon0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </memballoon>
Nov 24 18:55:20 user nova-compute[75051]:     <rng model='virtio'>
Nov 24 18:55:20 user nova-compute[75051]:       <backend model='random'>/dev/urandom</backend>
Nov 24 18:55:20 user nova-compute[75051]:       <alias name='rng0'/>
Nov 24 18:55:20 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 18:55:20 user nova-compute[75051]:     </rng>
Nov 24 18:55:20 user nova-compute[75051]:   </devices>
Nov 24 18:55:20 user nova-compute[75051]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 18:55:20 user nova-compute[75051]:     <label>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</label>
Nov 24 18:55:20 user nova-compute[75051]:     <imagelabel>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</imagelabel>
Nov 24 18:55:20 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:20 user nova-compute[75051]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 18:55:20 user nova-compute[75051]:     <label>+64055:+108</label>
Nov 24 18:55:20 user nova-compute[75051]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 18:55:20 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:20 user nova-compute[75051]: </domain>
Nov 24 18:55:20 user nova-compute[75051]:  {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 18:55:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully detached device tap5e5384ce-da from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the persistent domain config.
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] (1/8): Attempting to detach device tap5e5384ce-da with device alias net1 from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] detach device xml: <interface type="ethernet">
Nov 24 18:55:20 user nova-compute[75051]:   <mac address="fa:16:3e:70:c0:bf"/>
Nov 24 18:55:20 user nova-compute[75051]:   <model type="virtio"/>
Nov 24 18:55:20 user nova-compute[75051]:   <mtu size="1442"/>
Nov 24 18:55:20 user nova-compute[75051]:   <target dev="tap5e5384ce-da"/>
Nov 24 18:55:20 user nova-compute[75051]: </interface>
Nov 24 18:55:20 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d316ba-12b9-49ca-95a0-8cfd4ef6103d]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] SCSI volumes sdh have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[351ca689-5b1b-4f5a-9995-e2712b0a03ff]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82440c59-2428-4ce2-9aa7-6bb917045163]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260]
Nov 24 18:55:20 user nova-compute[75051]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4e566d-4616-4018-bc66-37e9a42fbc5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c769c-a363-4bb2-8c80-291465051f7c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== disconnect_volume: return (882ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.430s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QpmrshjT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 850395136 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e2259d-edc0-45c4-a294-ea586cc9e2d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: iSNS:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]: STATIC:
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11
Nov 24 18:55:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:20 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:20 user nova-compute[75051]: No targets found.
Nov 24 18:55:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:20 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:20 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b1db40-7084-46ea-99d8-425f525824c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Start waiting for the detach event from libvirt for device tap5e5384ce-da with device alias net1 for instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c6bcc-732c-425f-97ba-6909550f6858]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0424670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683233a-d06e-4b73-aeb2-c073fa47a272]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a6f092-d36f-4aea-a031-4ea63cb9b5f9]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50fd6b5-539f-4a16-8f32-7b8b41f49872]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b9287-28ba-4cbb-b8e1-6ea8f40b27e3]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a3c967-817e-4b6d-8743-223a3ce54fab]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-unplugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-unplugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:21 user nova-compute[75051]: WARNING nova.compute.manager [req-6eaab994-2e97-404c-8b86-1dae4da0c372 req-afa2dd26-f315-4353-a69e-2a6a6361f3ac service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-unplugged-5e5384ce-daff-46e4-bb67-d17297060d4b for instance with vm_state active and task_state None.
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[180bd720-c9fe-4cab-bff4-bd1b4972ddd9]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260]
Nov 24 18:55:21 user nova-compute[75051]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780459b0-ad74-4a6d-88e9-42bef53d3a11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[72991fc3-d098-4d88-baab-f8bbc96c71f1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== disconnect_volume: return (901ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.461s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgDbjsni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:21 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c251e7bc-014c-418a-87e7-e3dca432df6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]: iSNS:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]: STATIC:
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:21 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:21 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165fccc-e254-49e6-9eb9-8032fc847032]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce0afd-5fa3-4b99-9b4a-d19c89aac1e9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c01a04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4832e28a-4c8a-4ae9-b513-a3105ada979e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47c7af-60dc-42c4-bc33-8cca849e5169]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f8230e-a51a-431c-a4fd-d1a0f64046a8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c37fe1-3489-47d7-85bb-9f33e5e7d987]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[838fe4a8-9a60-4be2-9234-c91e93a55a44]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd262d3e-88c2-46c0-b0d1-835326d3a39c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260]
Nov 24 18:55:21 user nova-compute[75051]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:21 user nova-compute[75051]: WARNING nova.compute.manager [req-86b4162e-8189-42db-8d2b-52db4de54d6b req-29169774-44a2-426a-9d77-1bc26b39d95f service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuild_spawning.
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdc277a3-1626-4f22-962f-9e0ebe78b07b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad09ebd-af31-401d-8e7d-da974b028eb4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] <== disconnect_volume: return (919ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Deleting instance files /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189_del
Nov 24 18:55:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Deletion of /opt/stack/data/nova/instances/00a95e25-c59c-46f7-9aeb-d3f01146c189_del complete
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.465s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cf1f4c-58ba-45d1-840d-f2a4e49013b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]: iSNS:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]: STATIC:
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:21 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:21 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:21 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:21 user nova-compute[75051]: No targets found.
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:21 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:21 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a4911-1723-411f-9a19-f0c5bd7148b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08b0de-10b7-4044-ba97-b98cc4010ff1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 (non-flash)
Nov 24 18:55:21 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b839f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:21 user nova-compute[75051]: INFO nova.compute.manager [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Took 10.38 seconds to destroy the instance on the hypervisor.
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c3b8b-818c-4fe8-a799-b9cce828d7d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[977f0d99-515b-4058-b4ea-e544ea930161]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f806f-c13c-4dea-9ef7-1b69093cb5d7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a09e9e-d07e-486f-8df8-1293c462042b]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3f7e4-20d2-4a79-ad25-be9fe30f944c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dTgHNaDK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm', 'volume_id': 'dda56a69-a15c-4916-b3c5-16ed74b79cf5'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:22 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90074a5-c41b-4769-aecc-551d98b05fb6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260]
Nov 24 18:55:22 user nova-compute[75051]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa82bb68-7f8b-45cb-a519-935bbee42636 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7847464-c2e1-4049-a13f-fe291d8f5334]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] <== disconnect_volume: return (796ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Deleting instance files /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686_del
Nov 24 18:55:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Deletion of /opt/stack/data/nova/instances/e1ff9da6-e31d-49f6-a48f-56a2c4866686_del complete
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.068s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e512b444-0371-4861-8c70-2144d065496d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:22 user nova-compute[75051]: No targets found.
Nov 24 18:55:22 user nova-compute[75051]: iSNS:
Nov 24 18:55:22 user nova-compute[75051]: No targets found.
Nov 24 18:55:22 user nova-compute[75051]: STATIC:
Nov 24 18:55:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5
Nov 24 18:55:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:22 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:22 user nova-compute[75051]: No targets found.
Nov 24 18:55:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:22 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:22 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f285456-1a2a-4eec-b02b-e69e5c7be75b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1139351-59fd-408e-9e1a-1af12f78c4dc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0280e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5'): ({'sdm'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Removing single pathed devices sdm {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: INFO nova.compute.manager [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Took 9.88 seconds to destroy the instance on the hypervisor.
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6783c61-df24-4dec-94c9-fc103be3dc14]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25675898-2de4-4a67-85b1-f9c0cfd3cdad]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Flushing IO for device /dev/sdm {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf78132-a40e-4c53-a075-6f4d87b6c0c1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.059s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052ea58-69ce-4d52-ae67-389520f1a5eb]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] SCSI volumes sdm have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[14841cdb-7a45-49f3-a184-b12046404f77]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd206317-ca3c-4aff-9c4c-b217fe03d04f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260]
Nov 24 18:55:22 user nova-compute[75051]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda56a69-a15c-4916-b3c5-16ed74b79cf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3191687f-af56-4392-ba38-afdd08bf9f41]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] <== disconnect_volume: return (394ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f0410591-5d5c-473a-93a9-283730abc348', 'attached_at': '', 'detached_at': '', 'volume_id': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'serial'} {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 24 18:55:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: removing Cinder connection for volume dda56a69-a15c-4916-b3c5-16ed74b79cf5 {{(pid=75051) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:23 user nova-compute[75051]: WARNING nova.compute.manager [req-3c735770-aeb8-456a-8414-99046a4dbf88 req-b6cc1685-58ca-47ed-9240-594f67abf730 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-5e5384ce-daff-46e4-bb67-d17297060d4b for instance with vm_state active and task_state None.
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] [instance: f0410591-5d5c-473a-93a9-283730abc348] swap_volume: Updating volume dda56a69-a15c-4916-b3c5-16ed74b79cf5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xjOBXlrW", "auth_password": "le4hKqyOibZU91", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "af63b8b8-762f-4c61-94cd-7d1407ae2f53"}, "status": "reserved", "instance": "f0410591-5d5c-473a-93a9-283730abc348", "attached_at": "", "detached_at": "", "volume_id": "af63b8b8-762f-4c61-94cd-7d1407ae2f53", "serial": "af63b8b8-762f-4c61-94cd-7d1407ae2f53"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'no_device': None, 'attachment_id': '355846b5-a024-417e-8134-ae55fe0e82dc'} {{(pid=75051) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d1fd3c9f-3486-48fe-8a76-2e87d32fe8a4 tempest-TestVolumeSwap-2054030625 tempest-TestVolumeSwap-2054030625-project-admin] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.457s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:55:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance spawned successfully.
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:23 user nova-compute[75051]: WARNING nova.compute.manager [req-5b89fb13-b752-4dc5-9a27-87d7ec6d186d req-1d6560b1-f50b-4151-8edb-cc67fa718d97 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state rebuild_spawning.
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75051) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-abf1da23-a742-4f77-9ff1-e78c2741dc1b tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:24 user nova-compute[75051]: INFO nova.compute.manager [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Detaching volume af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:24 user nova-compute[75051]: INFO nova.virt.block_device [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Attempting to driver detach volume af63b8b8-762f-4c61-94cd-7d1407ae2f53 from mountpoint /dev/vdb
Nov 24 18:55:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Attempting to detach device vdb from instance f0410591-5d5c-473a-93a9-283730abc348 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:55:24 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:55:24 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:55:24 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:55:24 user nova-compute[75051]:   <serial>af63b8b8-762f-4c61-94cd-7d1407ae2f53</serial>
Nov 24 18:55:24 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:55:24 user nova-compute[75051]: </disk>
Nov 24 18:55:24 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:55:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Successfully detached device vdb from instance f0410591-5d5c-473a-93a9-283730abc348 from the persistent domain config.
Nov 24 18:55:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0410591-5d5c-473a-93a9-283730abc348 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:55:24 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:55:24 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:55:24 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:55:24 user nova-compute[75051]:   <serial>af63b8b8-762f-4c61-94cd-7d1407ae2f53</serial>
Nov 24 18:55:24 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:55:24 user nova-compute[75051]: </disk>
Nov 24 18:55:24 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:55:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-deleted-a9d6ec78-0eee-4f7f-bdeb-7232556cc90a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:25 user nova-compute[75051]: INFO nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Neutron deleted interface a9d6ec78-0eee-4f7f-bdeb-7232556cc90a; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "address": "fa:16:3e:88:ca:6a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e5ee6-9b", "ovs_interfaceid": "8c8e5ee6-9b37-4c3d-8102-07d3e354d574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Detach interface failed, port_id=a9d6ec78-0eee-4f7f-bdeb-7232556cc90a, reason: Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-deleted-6a7b4267-a8c3-4237-ad90-884dee0e889c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:26 user nova-compute[75051]: INFO nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Neutron deleted interface 6a7b4267-a8c3-4237-ad90-884dee0e889c; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "address": "fa:16:3e:0e:31:1b", "network": {"id": "f0fea18c-9c3b-4006-9aa7-978c19b39954", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1645225569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5a438c0-78", "ovs_interfaceid": "a5a438c0-7817-4d84-b3a9-c91f51a1d36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Detach interface failed, port_id=6a7b4267-a8c3-4237-ad90-884dee0e889c, reason: Instance 00a95e25-c59c-46f7-9aeb-d3f01146c189 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-deleted-8c8e5ee6-9b37-4c3d-8102-07d3e354d574 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:26 user nova-compute[75051]: INFO nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Neutron deleted interface 8c8e5ee6-9b37-4c3d-8102-07d3e354d574; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "address": "fa:16:3e:34:9a:1a", "network": {"id": "08a8b4a5-7529-4f85-87bc-e84a411d7840", "bridge": "br-int", "label": "tempest-device-tagging-net2-431660123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aa616a3-c7", "ovs_interfaceid": "5aa616a3-c72a-46a9-874e-ea0ba316edfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-21d71cf8-3264-411f-bbaa-1eff9652ba6a req-6ab075b1-cae3-45cf-ae2a-b97c2acd446a service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Detach interface failed, port_id=8c8e5ee6-9b37-4c3d-8102-07d3e354d574, reason: Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-deleted-a5a438c0-7817-4d84-b3a9-c91f51a1d36c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Neutron deleted interface a5a438c0-7817-4d84-b3a9-c91f51a1d36c; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86285a16-45ce-4fee-9115-d196637cccf3", "address": "fa:16:3e:32:8e:13", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86285a16-45", "ovs_interfaceid": "86285a16-45ce-4fee-9115-d196637cccf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Detach interface failed, port_id=a5a438c0-7817-4d84-b3a9-c91f51a1d36c, reason: Instance 00a95e25-c59c-46f7-9aeb-d3f01146c189 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-deleted-5aa616a3-c72a-46a9-874e-ea0ba316edfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Neutron deleted interface 5aa616a3-c72a-46a9-874e-ea0ba316edfa; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "address": "fa:16:3e:83:4c:d4", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea999b70-6d", "ovs_interfaceid": "ea999b70-6d0b-4d3c-a7d7-b627ca5bd920", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Detach interface failed, port_id=5aa616a3-c72a-46a9-874e-ea0ba316edfa, reason: Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-deleted-86285a16-45ce-4fee-9115-d196637cccf3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Neutron deleted interface 86285a16-45ce-4fee-9115-d196637cccf3; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [{"id": "ba629722-f270-40f0-920c-0bf684e25d75", "address": "fa:16:3e:c8:9c:43", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba629722-f2", "ovs_interfaceid": "ba629722-f270-40f0-920c-0bf684e25d75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1338870f-d540-4072-aa99-240541f1ccdc", "address": "fa:16:3e:a4:7b:ed", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1338870f-d5", "ovs_interfaceid": "1338870f-d540-4072-aa99-240541f1ccdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "address": "fa:16:3e:f4:b1:58", "network": {"id": "41b0cea8-6c83-4c78-b5dd-9f318a898cf8", "bridge": "br-int", "label": "tempest-device-tagging-net1-1378675110", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23b4241b-6f", "ovs_interfaceid": "23b4241b-6f88-481e-bd3e-bfa0c91f2ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ad060d-cc1f-4417-9732-27af3a1b8589", "address": "fa:16:3e:cb:0d:ea", "network": {"id": "8d6ecb3c-0d13-40b8-b03b-bab271721322", "bridge": "br-int", "label": "tempest-device-tagging-net2-1710646871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9dea95244ac640c59516fbcda9f1e028", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ad060d-cc", "ovs_interfaceid": "53ad060d-cc1f-4417-9732-27af3a1b8589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Detach interface failed, port_id=86285a16-45ce-4fee-9115-d196637cccf3, reason: Instance 00a95e25-c59c-46f7-9aeb-d3f01146c189 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-deleted-ea999b70-6d0b-4d3c-a7d7-b627ca5bd920 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Neutron deleted interface ea999b70-6d0b-4d3c-a7d7-b627ca5bd920; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [{"id": "f8031932-a2e0-4d12-9f38-04273d53b85a", "address": "fa:16:3e:4c:e2:a6", "network": {"id": "e7a4f1f3-dc42-4251-92e2-9007e9d6d956", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1590718409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8031932-a2", "ovs_interfaceid": "f8031932-a2e0-4d12-9f38-04273d53b85a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b1010f31-a7d7-4156-9113-a02ab3de36df", "address": "fa:16:3e:b2:44:4f", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1010f31-a7", "ovs_interfaceid": "b1010f31-a7d7-4156-9113-a02ab3de36df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "address": "fa:16:3e:8d:1a:8a", "network": {"id": "f7937961-1c75-4ecd-ad1f-36a616fccbc0", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155211892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f37c20b6ddd74260b6b62417476cdc7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1482f34a-9d", "ovs_interfaceid": "1482f34a-9d12-434c-9eb9-cef34a221e9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-81f78e8e-e91a-4749-b44b-e2d5c1a8393b req-71688362-d193-465d-896b-ff30237e73f7 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Detach interface failed, port_id=ea999b70-6d0b-4d3c-a7d7-b627ca5bd920, reason: Instance e1ff9da6-e31d-49f6-a48f-56a2c4866686 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Took 6.44 seconds to deallocate network for instance.
Nov 24 18:55:28 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:28 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Took 6.96 seconds to deallocate network for instance.
Nov 24 18:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-29f0de2b-8c67-40dd-b890-cf622da12372 req-ebb16c61-7418-44cd-a828-95086b655002 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-deleted-53ad060d-cc1f-4417-9732-27af3a1b8589 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-29f0de2b-8c67-40dd-b890-cf622da12372 req-ebb16c61-7418-44cd-a828-95086b655002 service nova] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Received event network-vif-deleted-f8031932-a2e0-4d12-9f38-04273d53b85a {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-29f0de2b-8c67-40dd-b890-cf622da12372 req-ebb16c61-7418-44cd-a828-95086b655002 service nova] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Received event network-vif-deleted-23b4241b-6f88-481e-bd3e-bfa0c91f2ec9 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:31 user nova-compute[75051]: INFO nova.compute.manager [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] [instance: e1ff9da6-e31d-49f6-a48f-56a2c4866686] Took 2.37 seconds to detach 3 volumes for instance.
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:31 user nova-compute[75051]: INFO nova.compute.manager [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] [instance: 00a95e25-c59c-46f7-9aeb-d3f01146c189] Took 2.29 seconds to detach 3 volumes for instance.
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.243s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:31 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Deleted allocations for instance e1ff9da6-e31d-49f6-a48f-56a2c4866686
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0dddaeb6-bfd5-42cf-9f48-f26b5d676a24 tempest-TaggedBootDevicesTest_v242-300268766 tempest-TaggedBootDevicesTest_v242-300268766-project-member] Lock "e1ff9da6-e31d-49f6-a48f-56a2c4866686" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.237s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:31 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Deleted allocations for instance 00a95e25-c59c-46f7-9aeb-d3f01146c189
Nov 24 18:55:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-998d81f2-95f0-4cd6-bbc9-7bef2367367c tempest-TaggedBootDevicesTest-198222194 tempest-TaggedBootDevicesTest-198222194-project-member] Lock "00a95e25-c59c-46f7-9aeb-d3f01146c189" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 20.377s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 18:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Waiting for libvirt event about the detach of device tap5e5384ce-da with device alias net1 from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd is timed out.
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 18:55:41 user nova-compute[75051]:   <name>instance-00000008</name>
Nov 24 18:55:41 user nova-compute[75051]:   <uuid>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</uuid>
Nov 24 18:55:41 user nova-compute[75051]:   <metadata>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:41 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:54:43</nova:creationTime>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:41 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="5e5384ce-daff-46e4-bb67-d17297060d4b">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.10.10.254" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:41 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:41 user nova-compute[75051]:   </metadata>
Nov 24 18:55:41 user nova-compute[75051]:   <memory unit='KiB'>524288</memory>
Nov 24 18:55:41 user nova-compute[75051]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 18:55:41 user nova-compute[75051]:   <vcpu placement='static'>1</vcpu>
Nov 24 18:55:41 user nova-compute[75051]:   <resource>
Nov 24 18:55:41 user nova-compute[75051]:     <partition>/machine</partition>
Nov 24 18:55:41 user nova-compute[75051]:   </resource>
Nov 24 18:55:41 user nova-compute[75051]:   <sysinfo type='smbios'>
Nov 24 18:55:41 user nova-compute[75051]:     <system>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='version'>0.0.0</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='serial'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='uuid'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='family'>Virtual Machine</entry>
Nov 24 18:55:41 user nova-compute[75051]:     </system>
Nov 24 18:55:41 user nova-compute[75051]:   </sysinfo>
Nov 24 18:55:41 user nova-compute[75051]:   <os>
Nov 24 18:55:41 user nova-compute[75051]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 18:55:41 user nova-compute[75051]:     <boot dev='hd'/>
Nov 24 18:55:41 user nova-compute[75051]:     <smbios mode='sysinfo'/>
Nov 24 18:55:41 user nova-compute[75051]:   </os>
Nov 24 18:55:41 user nova-compute[75051]:   <features>
Nov 24 18:55:41 user nova-compute[75051]:     <acpi/>
Nov 24 18:55:41 user nova-compute[75051]:     <apic/>
Nov 24 18:55:41 user nova-compute[75051]:     <vmcoreinfo state='on'/>
Nov 24 18:55:41 user nova-compute[75051]:   </features>
Nov 24 18:55:41 user nova-compute[75051]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 18:55:41 user nova-compute[75051]:     <model fallback='forbid'>Nehalem</model>
Nov 24 18:55:41 user nova-compute[75051]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='vme'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='x2apic'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='hypervisor'/>
Nov 24 18:55:41 user nova-compute[75051]:   </cpu>
Nov 24 18:55:41 user nova-compute[75051]:   <clock offset='utc'>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='hpet' present='no'/>
Nov 24 18:55:41 user nova-compute[75051]:   </clock>
Nov 24 18:55:41 user nova-compute[75051]:   <on_poweroff>destroy</on_poweroff>
Nov 24 18:55:41 user nova-compute[75051]:   <on_reboot>restart</on_reboot>
Nov 24 18:55:41 user nova-compute[75051]:   <on_crash>destroy</on_crash>
Nov 24 18:55:41 user nova-compute[75051]:   <devices>
Nov 24 18:55:41 user nova-compute[75051]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='disk'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk' index='2'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore type='file' index='3'>
Nov 24 18:55:41 user nova-compute[75051]:         <format type='raw'/>
Nov 24 18:55:41 user nova-compute[75051]:         <source file='/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451'/>
Nov 24 18:55:41 user nova-compute[75051]:         <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       </backingStore>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='vda' bus='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='virtio-disk0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='cdrom'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config' index='1'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='hda' bus='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <readonly/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide0-0-0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='usb' index='0' model='none'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='usb'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='pci.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='ide' index='0'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <interface type='ethernet'>
Nov 24 18:55:41 user nova-compute[75051]:       <mac address='fa:16:3e:6b:7b:1b'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='tap100a87c1-4a'/>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <mtu size='1442'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='net0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </interface>
Nov 24 18:55:41 user nova-compute[75051]:     <serial type='pty'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='isa-serial' port='0'>
Nov 24 18:55:41 user nova-compute[75051]:         <model name='isa-serial'/>
Nov 24 18:55:41 user nova-compute[75051]:       </target>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </serial>
Nov 24 18:55:41 user nova-compute[75051]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='serial' port='0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </console>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='mouse' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='keyboard' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 18:55:41 user nova-compute[75051]:       <listen type='address' address='0.0.0.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </graphics>
Nov 24 18:55:41 user nova-compute[75051]:     <audio id='1' type='none'/>
Nov 24 18:55:41 user nova-compute[75051]:     <video>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='video0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </video>
Nov 24 18:55:41 user nova-compute[75051]:     <memballoon model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <stats period='10'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='balloon0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </memballoon>
Nov 24 18:55:41 user nova-compute[75051]:     <rng model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <backend model='random'>/dev/urandom</backend>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='rng0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </rng>
Nov 24 18:55:41 user nova-compute[75051]:   </devices>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>+64055:+108</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]: </domain>
Nov 24 18:55:41 user nova-compute[75051]:  {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 18:55:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully detached device tap5e5384ce-da from instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd from the live domain config.
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG os_vif [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e5384ce-da, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6b36a55-91bf-442b-924d-cc9db906774d) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: INFO os_vif [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da')
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:41 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:55:41</nova:creationTime>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:41 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:41 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:41 user nova-compute[75051]:  {{(pid=75051) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:41 user nova-compute[75051]: INFO nova.compute.manager [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Terminating instance
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-deleted-5e5384ce-daff-46e4-bb67-d17297060d4b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:41 user nova-compute[75051]: INFO nova.compute.manager [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Neutron deleted interface 5e5384ce-daff-46e4-bb67-d17297060d4b; detaching it from the instance and deleting it from the info cache
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.neutron [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquired lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.objects.instance [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Lazy-loading 'system_metadata' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.objects.instance [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Lazy-loading 'flavor' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.objects.base [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Object Instance<197a4531-4f1f-40b1-b8b9-03a2ad5e47bd> lazy-loaded attributes: system_metadata,flavor {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 18:55:41 user nova-compute[75051]:   <name>instance-00000008</name>
Nov 24 18:55:41 user nova-compute[75051]:   <uuid>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</uuid>
Nov 24 18:55:41 user nova-compute[75051]:   <metadata>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:41 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:55:41</nova:creationTime>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:41 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:41 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:41 user nova-compute[75051]:   </metadata>
Nov 24 18:55:41 user nova-compute[75051]:   <memory unit='KiB'>524288</memory>
Nov 24 18:55:41 user nova-compute[75051]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 18:55:41 user nova-compute[75051]:   <vcpu placement='static'>1</vcpu>
Nov 24 18:55:41 user nova-compute[75051]:   <resource>
Nov 24 18:55:41 user nova-compute[75051]:     <partition>/machine</partition>
Nov 24 18:55:41 user nova-compute[75051]:   </resource>
Nov 24 18:55:41 user nova-compute[75051]:   <sysinfo type='smbios'>
Nov 24 18:55:41 user nova-compute[75051]:     <system>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='version'>0.0.0</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='serial'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='uuid'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='family'>Virtual Machine</entry>
Nov 24 18:55:41 user nova-compute[75051]:     </system>
Nov 24 18:55:41 user nova-compute[75051]:   </sysinfo>
Nov 24 18:55:41 user nova-compute[75051]:   <os>
Nov 24 18:55:41 user nova-compute[75051]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 18:55:41 user nova-compute[75051]:     <boot dev='hd'/>
Nov 24 18:55:41 user nova-compute[75051]:     <smbios mode='sysinfo'/>
Nov 24 18:55:41 user nova-compute[75051]:   </os>
Nov 24 18:55:41 user nova-compute[75051]:   <features>
Nov 24 18:55:41 user nova-compute[75051]:     <acpi/>
Nov 24 18:55:41 user nova-compute[75051]:     <apic/>
Nov 24 18:55:41 user nova-compute[75051]:     <vmcoreinfo state='on'/>
Nov 24 18:55:41 user nova-compute[75051]:   </features>
Nov 24 18:55:41 user nova-compute[75051]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 18:55:41 user nova-compute[75051]:     <model fallback='forbid'>Nehalem</model>
Nov 24 18:55:41 user nova-compute[75051]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='vme'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='x2apic'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='hypervisor'/>
Nov 24 18:55:41 user nova-compute[75051]:   </cpu>
Nov 24 18:55:41 user nova-compute[75051]:   <clock offset='utc'>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='hpet' present='no'/>
Nov 24 18:55:41 user nova-compute[75051]:   </clock>
Nov 24 18:55:41 user nova-compute[75051]:   <on_poweroff>destroy</on_poweroff>
Nov 24 18:55:41 user nova-compute[75051]:   <on_reboot>restart</on_reboot>
Nov 24 18:55:41 user nova-compute[75051]:   <on_crash>destroy</on_crash>
Nov 24 18:55:41 user nova-compute[75051]:   <devices>
Nov 24 18:55:41 user nova-compute[75051]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='disk'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk' index='2'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore type='file' index='3'>
Nov 24 18:55:41 user nova-compute[75051]:         <format type='raw'/>
Nov 24 18:55:41 user nova-compute[75051]:         <source file='/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451'/>
Nov 24 18:55:41 user nova-compute[75051]:         <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       </backingStore>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='vda' bus='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='virtio-disk0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='cdrom'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config' index='1'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='hda' bus='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <readonly/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide0-0-0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='usb' index='0' model='none'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='usb'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='pci.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='ide' index='0'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <interface type='ethernet'>
Nov 24 18:55:41 user nova-compute[75051]:       <mac address='fa:16:3e:6b:7b:1b'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='tap100a87c1-4a'/>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <mtu size='1442'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='net0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </interface>
Nov 24 18:55:41 user nova-compute[75051]:     <serial type='pty'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='isa-serial' port='0'>
Nov 24 18:55:41 user nova-compute[75051]:         <model name='isa-serial'/>
Nov 24 18:55:41 user nova-compute[75051]:       </target>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </serial>
Nov 24 18:55:41 user nova-compute[75051]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='serial' port='0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </console>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='mouse' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='keyboard' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 18:55:41 user nova-compute[75051]:       <listen type='address' address='0.0.0.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </graphics>
Nov 24 18:55:41 user nova-compute[75051]:     <audio id='1' type='none'/>
Nov 24 18:55:41 user nova-compute[75051]:     <video>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='video0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </video>
Nov 24 18:55:41 user nova-compute[75051]:     <memballoon model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <stats period='10'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='balloon0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </memballoon>
Nov 24 18:55:41 user nova-compute[75051]:     <rng model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <backend model='random'>/dev/urandom</backend>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='rng0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </rng>
Nov 24 18:55:41 user nova-compute[75051]:   </devices>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>+64055:+108</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]: </domain>
Nov 24 18:55:41 user nova-compute[75051]:  {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface> {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:70:c0:bf"/><model type="virtio"/><mtu size="1442"/><target dev="tap5e5384ce-da"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 24 18:55:41 user nova-compute[75051]:   <name>instance-00000008</name>
Nov 24 18:55:41 user nova-compute[75051]:   <uuid>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</uuid>
Nov 24 18:55:41 user nova-compute[75051]:   <metadata>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:41 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:55:41</nova:creationTime>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:41 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:41 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:41 user nova-compute[75051]:   </metadata>
Nov 24 18:55:41 user nova-compute[75051]:   <memory unit='KiB'>524288</memory>
Nov 24 18:55:41 user nova-compute[75051]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 24 18:55:41 user nova-compute[75051]:   <vcpu placement='static'>1</vcpu>
Nov 24 18:55:41 user nova-compute[75051]:   <resource>
Nov 24 18:55:41 user nova-compute[75051]:     <partition>/machine</partition>
Nov 24 18:55:41 user nova-compute[75051]:   </resource>
Nov 24 18:55:41 user nova-compute[75051]:   <sysinfo type='smbios'>
Nov 24 18:55:41 user nova-compute[75051]:     <system>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='product'>OpenStack Nova</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='version'>0.0.0</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='serial'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='uuid'>197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</entry>
Nov 24 18:55:41 user nova-compute[75051]:       <entry name='family'>Virtual Machine</entry>
Nov 24 18:55:41 user nova-compute[75051]:     </system>
Nov 24 18:55:41 user nova-compute[75051]:   </sysinfo>
Nov 24 18:55:41 user nova-compute[75051]:   <os>
Nov 24 18:55:41 user nova-compute[75051]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 24 18:55:41 user nova-compute[75051]:     <boot dev='hd'/>
Nov 24 18:55:41 user nova-compute[75051]:     <smbios mode='sysinfo'/>
Nov 24 18:55:41 user nova-compute[75051]:   </os>
Nov 24 18:55:41 user nova-compute[75051]:   <features>
Nov 24 18:55:41 user nova-compute[75051]:     <acpi/>
Nov 24 18:55:41 user nova-compute[75051]:     <apic/>
Nov 24 18:55:41 user nova-compute[75051]:     <vmcoreinfo state='on'/>
Nov 24 18:55:41 user nova-compute[75051]:   </features>
Nov 24 18:55:41 user nova-compute[75051]:   <cpu mode='custom' match='exact' check='full'>
Nov 24 18:55:41 user nova-compute[75051]:     <model fallback='forbid'>Nehalem</model>
Nov 24 18:55:41 user nova-compute[75051]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='vme'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='x2apic'/>
Nov 24 18:55:41 user nova-compute[75051]:     <feature policy='require' name='hypervisor'/>
Nov 24 18:55:41 user nova-compute[75051]:   </cpu>
Nov 24 18:55:41 user nova-compute[75051]:   <clock offset='utc'>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='pit' tickpolicy='delay'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 24 18:55:41 user nova-compute[75051]:     <timer name='hpet' present='no'/>
Nov 24 18:55:41 user nova-compute[75051]:   </clock>
Nov 24 18:55:41 user nova-compute[75051]:   <on_poweroff>destroy</on_poweroff>
Nov 24 18:55:41 user nova-compute[75051]:   <on_reboot>restart</on_reboot>
Nov 24 18:55:41 user nova-compute[75051]:   <on_crash>destroy</on_crash>
Nov 24 18:55:41 user nova-compute[75051]:   <devices>
Nov 24 18:55:41 user nova-compute[75051]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='disk'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk' index='2'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore type='file' index='3'>
Nov 24 18:55:41 user nova-compute[75051]:         <format type='raw'/>
Nov 24 18:55:41 user nova-compute[75051]:         <source file='/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451'/>
Nov 24 18:55:41 user nova-compute[75051]:         <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       </backingStore>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='vda' bus='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='virtio-disk0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <disk type='file' device='cdrom'>
Nov 24 18:55:41 user nova-compute[75051]:       <driver name='qemu' type='raw' cache='none'/>
Nov 24 18:55:41 user nova-compute[75051]:       <source file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk.config' index='1'/>
Nov 24 18:55:41 user nova-compute[75051]:       <backingStore/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='hda' bus='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <readonly/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide0-0-0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </disk>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='usb' index='0' model='none'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='usb'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='pci' index='0' model='pci-root'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='pci.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <controller type='ide' index='0'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='ide'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </controller>
Nov 24 18:55:41 user nova-compute[75051]:     <interface type='ethernet'>
Nov 24 18:55:41 user nova-compute[75051]:       <mac address='fa:16:3e:6b:7b:1b'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target dev='tap100a87c1-4a'/>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio'/>
Nov 24 18:55:41 user nova-compute[75051]:       <mtu size='1442'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='net0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </interface>
Nov 24 18:55:41 user nova-compute[75051]:     <serial type='pty'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='isa-serial' port='0'>
Nov 24 18:55:41 user nova-compute[75051]:         <model name='isa-serial'/>
Nov 24 18:55:41 user nova-compute[75051]:       </target>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </serial>
Nov 24 18:55:41 user nova-compute[75051]:     <console type='pty' tty='/dev/pts/5'>
Nov 24 18:55:41 user nova-compute[75051]:       <source path='/dev/pts/5'/>
Nov 24 18:55:41 user nova-compute[75051]:       <log file='/opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/console.log' append='off'/>
Nov 24 18:55:41 user nova-compute[75051]:       <target type='serial' port='0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='serial0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </console>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='mouse' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <input type='keyboard' bus='ps2'>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='input1'/>
Nov 24 18:55:41 user nova-compute[75051]:     </input>
Nov 24 18:55:41 user nova-compute[75051]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 24 18:55:41 user nova-compute[75051]:       <listen type='address' address='0.0.0.0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </graphics>
Nov 24 18:55:41 user nova-compute[75051]:     <audio id='1' type='none'/>
Nov 24 18:55:41 user nova-compute[75051]:     <video>
Nov 24 18:55:41 user nova-compute[75051]:       <model type='virtio' heads='1' primary='yes'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='video0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </video>
Nov 24 18:55:41 user nova-compute[75051]:     <memballoon model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <stats period='10'/>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='balloon0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </memballoon>
Nov 24 18:55:41 user nova-compute[75051]:     <rng model='virtio'>
Nov 24 18:55:41 user nova-compute[75051]:       <backend model='random'>/dev/urandom</backend>
Nov 24 18:55:41 user nova-compute[75051]:       <alias name='rng0'/>
Nov 24 18:55:41 user nova-compute[75051]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 24 18:55:41 user nova-compute[75051]:     </rng>
Nov 24 18:55:41 user nova-compute[75051]:   </devices>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>libvirt-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 24 18:55:41 user nova-compute[75051]:     <label>+64055:+108</label>
Nov 24 18:55:41 user nova-compute[75051]:     <imagelabel>+64055:+108</imagelabel>
Nov 24 18:55:41 user nova-compute[75051]:   </seclabel>
Nov 24 18:55:41 user nova-compute[75051]: </domain>
Nov 24 18:55:41 user nova-compute[75051]:  {{(pid=75051) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 24 18:55:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Detaching interface fa:16:3e:70:c0:bf failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap5e5384ce-da' not found.
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Converting VIF {"id": "5e5384ce-daff-46e4-bb67-d17297060d4b", "address": "fa:16:3e:70:c0:bf", "network": {"id": "53f301d6-60b5-4db7-8b49-0327d193ec35", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1938431522", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5384ce-da", "ovs_interfaceid": "5e5384ce-daff-46e4-bb67-d17297060d4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG os_vif [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e5384ce-da, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:55:41 user nova-compute[75051]: INFO os_vif [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:c0:bf,bridge_name='br-int',has_traffic_filtering=True,id=5e5384ce-daff-46e4-bb67-d17297060d4b,network=Network(53f301d6-60b5-4db7-8b49-0327d193ec35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5384ce-da')
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [req-8ba81a9f-27c3-4da1-932a-650d612cf1dd req-cc314b8b-a6af-45c2-8993-d1aedb582ec5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:55:41 user nova-compute[75051]:   <nova:package version="0.0.0"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:name>tempest-device-tagging-server-304976420</nova:name>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:creationTime>2023-11-24 18:55:41</nova:creationTime>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:flavor name="m1.tiny">
Nov 24 18:55:41 user nova-compute[75051]:     <nova:memory>512</nova:memory>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:disk>1</nova:disk>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:swap>0</nova:swap>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:vcpus>1</nova:vcpus>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:flavor>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:user uuid="acd941243b164658bf180f3c31cb732d">tempest-TaggedAttachmentsTest-374653462-project-member</nova:user>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:project uuid="1977597f2a324ed4ba4ca3794b12957f">tempest-TaggedAttachmentsTest-374653462</nova:project>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:owner>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:55:41 user nova-compute[75051]:   <nova:ports>
Nov 24 18:55:41 user nova-compute[75051]:     <nova:port uuid="100a87c1-4a68-4946-a293-96ace9269687">
Nov 24 18:55:41 user nova-compute[75051]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:55:41 user nova-compute[75051]:     </nova:port>
Nov 24 18:55:41 user nova-compute[75051]:   </nova:ports>
Nov 24 18:55:41 user nova-compute[75051]: </nova:instance>
Nov 24 18:55:41 user nova-compute[75051]:  {{(pid=75051) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-unplugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] No waiting events found dispatching network-vif-unplugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-0ced9bcb-63b9-47a7-98b9-a09839527880 req-bff43fd5-167f-4ecf-8baa-4e33bffa79f0 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-unplugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [{"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Releasing lock "refresh_cache-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d9d9b10e-9a4f-475c-8a75-2dc3b1042340 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "interface-197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-5e5384ce-daff-46e4-bb67-d17297060d4b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.590s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Instance destroyed successfully.
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lazy-loading 'resources' on Instance uuid e0d31370-4bdb-4804-b1d5-5e4a19a41912 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-390187256',display_name='tempest-VolumesAssistedSnapshotsTest-server-390187256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-390187256',id=5,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQz+uQFNPW7scqkOWuoiaEF/3AD/NqlWEhNnOAL3NTNKVRoQd3C5qyb5a+0FnGkonXwwTpu7mMT++t4H1TtbYYLAa1KmNsBZYYmhm94FMwoPiZCotvrVU5kr8sld/Tkkw==',key_name='tempest-keypair-544936102',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90fc5236fe074402a3e6ea23353b7677',ramdisk_id='',reservation_id='r-rs7ic1vu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1472399647',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1472399647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fc348da26af46129290241674d373d3',uuid=e0d31370-4bdb-4804-b1d5-5e4a19a41912,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converting VIF {"id": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "address": "fa:16:3e:29:aa:8a", "network": {"id": "df640d1e-8e59-4821-8ed6-4fff6f61c89a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-228299490-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90fc5236fe074402a3e6ea23353b7677", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd6266f-d4", "ovs_interfaceid": "7cd6266f-d44e-44a9-8033-3e977fe8e3a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG os_vif [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cd6266f-d4, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d1850d2-d689-4b1e-b4e3-fb130cd90f02) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:42 user nova-compute[75051]: INFO os_vif [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:aa:8a,bridge_name='br-int',has_traffic_filtering=True,id=7cd6266f-d44e-44a9-8033-3e977fe8e3a0,network=Network(df640d1e-8e59-4821-8ed6-4fff6f61c89a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd6266f-d4')
Nov 24 18:55:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Deleting instance files /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912_del
Nov 24 18:55:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Deletion of /opt/stack/data/nova/instances/e0d31370-4bdb-4804-b1d5-5e4a19a41912_del complete
Nov 24 18:55:42 user nova-compute[75051]: INFO nova.compute.manager [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 18:55:42 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:55:42 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:55:42 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Took 0.66 seconds to deallocate network for instance.
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:43 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Deleted allocations for instance e0d31370-4bdb-4804-b1d5-5e4a19a41912
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50c05644-3455-46b4-9814-e429c49d739b tempest-VolumesAssistedSnapshotsTest-1472399647 tempest-VolumesAssistedSnapshotsTest-1472399647-project-member] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-b7fe6d69-d590-4f6a-97b5-6628951f8611 req-42083d75-165e-4d42-b0db-f9dc73bd9475 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-deleted-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] Acquiring lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] Lock "e0d31370-4bdb-4804-b1d5-5e4a19a41912-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] No waiting events found dispatching network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:55:43 user nova-compute[75051]: WARNING nova.compute.manager [req-1e591288-f084-4d6a-ae66-4f7263d17786 req-94587a0e-1dd0-45ad-84a7-c2b829b15f65 service nova] [instance: e0d31370-4bdb-4804-b1d5-5e4a19a41912] Received unexpected event network-vif-plugged-7cd6266f-d44e-44a9-8033-3e977fe8e3a0 for instance with vm_state deleted and task_state None.
Nov 24 18:55:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0410591-5d5c-473a-93a9-283730abc348 is timed out.
Nov 24 18:55:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Successfully detached device vdb from instance f0410591-5d5c-473a-93a9-283730abc348 from the live domain config.
Nov 24 18:55:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xjOBXlrW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'af63b8b8-762f-4c61-94cd-7d1407ae2f53'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:55:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fac900b-9853-4416-b1fb-f67cc58d519e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:55:44 user nova-compute[75051]: No targets found.
Nov 24 18:55:44 user nova-compute[75051]: iSNS:
Nov 24 18:55:44 user nova-compute[75051]: No targets found.
Nov 24 18:55:44 user nova-compute[75051]: STATIC:
Nov 24 18:55:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53
Nov 24 18:55:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:55:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:55:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:55:44 user nova-compute[75051]: FIRMWARE:
Nov 24 18:55:44 user nova-compute[75051]: No targets found.
Nov 24 18:55:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:55:44 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:55:44 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f5f62c-64b7-43f2-a953-aa137daf7cf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6088fb73-b205-4b8d-8519-15ef47836e42]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:44 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 (non-flash)
Nov 24 18:55:44 user nova-compute[75051]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:55:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0405480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a2b20a-b6d4-4f4b-a0c2-8e2335837d52]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c86b3a-c16d-45c3-b21b-264e787ad379]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:55:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a30f21-c3b5-400c-a823-bbbb5d8643b1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6516cd42-716d-4d66-a934-2d88b5a5b8d1]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce4f92-0b3c-4266-bd6d-57a024e65228]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[413aed70-0c18-4f98-9b14-2f53593e939f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260]
Nov 24 18:55:45 user nova-compute[75051]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53, portal: 172.16.0.220,3260] successful.
Nov 24 18:55:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af63b8b8-762f-4c61-94cd-7d1407ae2f53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec7ae58-a38f-440b-be72-c1795f1e898e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] <== disconnect_volume: return (301ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:55:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lazy-loading 'flavor' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:55:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a0f866b6-410d-44fa-94dd-6f61e4f5f7e6 tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:55:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:55:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:04 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'flavor' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:56:05 user nova-compute[75051]: INFO nova.compute.claims [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Claim successful on node user
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:05 user nova-compute[75051]: INFO nova.compute.manager [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Attaching volume ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac to /dev/vdb
Nov 24 18:56:05 user nova-compute[75051]: DEBUG os_brick.utils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0719f0-8fe5-43de-99d8-e28e8e977c51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746a5f0-4064-4419-aa04-1eb220f795de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f79201-ec6e-492e-b65b-598ab908214b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae7e57-eaf6-4c98-bf71-be99f50974ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:06 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd84c2b-97a1-4a42-a623-dde64e1331f0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG os_brick.utils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating existing volume attachment record: 5aef42c5-58ea-49fb-ba00-b478424ec44e {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:56:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:56:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Creating image(s)
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "/opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "/opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG nova.policy [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e67434b135854fcfbf6d89ab0585ff39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f33c0ab52ea46f88d188aba75f5dea0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.212s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk 1073741824" returned: 0 in 0.065s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Cannot resize image /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Ensure instance console log exists: /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Successfully created port: be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:56:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=25.552154541015625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f0410591-5d5c-473a-93a9-283730abc348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bec46576-e2b6-4bc9-8648-5cc341ac2144 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee44d98-b374-4d33-add8-d55fc15309cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.477s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:56:08 user nova-compute[75051]: INFO nova.compute.claims [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Claim successful on node user
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Successfully updated port: be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquired lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-changed-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Refreshing instance network info cache due to event network-changed-be5315fe-1fc2-4a50-bfd7-61b664930081. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] Acquiring lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:56:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Updating instance_info_cache with network_info: [{"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:09 user nova-compute[75051]: INFO nova.virt.block_device [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Booting with blank volume at /dev/vda
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Releasing lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Instance network_info: |[{"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] Acquired lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Refreshing network info cache for port be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Start _get_guest_xml network_info=[{"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.policy [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88113529ca6747f281d4203c9c1d845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae7be1d57e44aae8c9b5695bba53ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:56:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2111282644',display_name='tempest-VolumesNegativeTest-instance-2111282644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2111282644',id=13,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f33c0ab52ea46f88d188aba75f5dea0',ramdisk_id='',reservation_id='r-xqg6y2vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-213499810',owner_user_name='tempest-VolumesNegativeTest-213499810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:07Z,user_data=None,user_id='e67434b135854fcfbf6d89ab0585ff39',uuid=f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converting VIF {"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lazy-loading 'pci_devices' on Instance uuid f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:56:09 user nova-compute[75051]:   <uuid>f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e</uuid>
Nov 24 18:56:09 user nova-compute[75051]:   <name>instance-0000000d</name>
Nov 24 18:56:09 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:56:09 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:56:09 user nova-compute[75051]:   <metadata>
Nov 24 18:56:09 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:56:09 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:name>tempest-VolumesNegativeTest-instance-2111282644</nova:name>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:56:09</nova:creationTime>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:56:09 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:56:09 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:owner>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:user uuid="e67434b135854fcfbf6d89ab0585ff39">tempest-VolumesNegativeTest-213499810-project-member</nova:user>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:project uuid="0f33c0ab52ea46f88d188aba75f5dea0">tempest-VolumesNegativeTest-213499810</nova:project>
Nov 24 18:56:09 user nova-compute[75051]:       </nova:owner>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:56:09 user nova-compute[75051]:       <nova:ports>
Nov 24 18:56:09 user nova-compute[75051]:         <nova:port uuid="be5315fe-1fc2-4a50-bfd7-61b664930081">
Nov 24 18:56:09 user nova-compute[75051]:           <nova:ip type="fixed" address="192.168.233.112" ipVersion="4"/>
Nov 24 18:56:09 user nova-compute[75051]:         </nova:port>
Nov 24 18:56:09 user nova-compute[75051]:       </nova:ports>
Nov 24 18:56:09 user nova-compute[75051]:     </nova:instance>
Nov 24 18:56:09 user nova-compute[75051]:   </metadata>
Nov 24 18:56:09 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:56:09 user nova-compute[75051]:     <system>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="serial">f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e</entry>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="uuid">f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e</entry>
Nov 24 18:56:09 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:56:09 user nova-compute[75051]:     </system>
Nov 24 18:56:09 user nova-compute[75051]:   </sysinfo>
Nov 24 18:56:09 user nova-compute[75051]:   <os>
Nov 24 18:56:09 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:56:09 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:56:09 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:56:09 user nova-compute[75051]:   </os>
Nov 24 18:56:09 user nova-compute[75051]:   <features>
Nov 24 18:56:09 user nova-compute[75051]:     <acpi/>
Nov 24 18:56:09 user nova-compute[75051]:     <apic/>
Nov 24 18:56:09 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:56:09 user nova-compute[75051]:   </features>
Nov 24 18:56:09 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:56:09 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:56:09 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:56:09 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:56:09 user nova-compute[75051]:   </clock>
Nov 24 18:56:09 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:56:09 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:56:09 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:56:09 user nova-compute[75051]:   </cpu>
Nov 24 18:56:09 user nova-compute[75051]:   <devices>
Nov 24 18:56:09 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:56:09 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:56:09 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk"/>
Nov 24 18:56:09 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:56:09 user nova-compute[75051]:     </disk>
Nov 24 18:56:09 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:56:09 user nova-compute[75051]:       <mac address="fa:16:3e:d4:36:aa"/>
Nov 24 18:56:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:09 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:56:09 user nova-compute[75051]:       <target dev="tapbe5315fe-1f"/>
Nov 24 18:56:09 user nova-compute[75051]:     </interface>
Nov 24 18:56:09 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:56:09 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/console.log" append="off"/>
Nov 24 18:56:09 user nova-compute[75051]:     </serial>
Nov 24 18:56:09 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:56:09 user nova-compute[75051]:     <video>
Nov 24 18:56:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:09 user nova-compute[75051]:     </video>
Nov 24 18:56:09 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:56:09 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:56:09 user nova-compute[75051]:     </rng>
Nov 24 18:56:09 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:56:09 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:56:09 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:56:09 user nova-compute[75051]:     </memballoon>
Nov 24 18:56:09 user nova-compute[75051]:   </devices>
Nov 24 18:56:09 user nova-compute[75051]: </domain>
Nov 24 18:56:09 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2111282644',display_name='tempest-VolumesNegativeTest-instance-2111282644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2111282644',id=13,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f33c0ab52ea46f88d188aba75f5dea0',ramdisk_id='',reservation_id='r-xqg6y2vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-213499810',owner_user_name='tempest-VolumesNegativeTest-213499810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:07Z,user_data=None,user_id='e67434b135854fcfbf6d89ab0585ff39',uuid=f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converting VIF {"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG os_vif [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e067ad6a-2c56-5e09-a73e-fb7ef906408b', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe5315fe-1f, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe5315fe-1f, col_values=(('qos', UUID('409e1ae6-4fc4-42fd-8911-72397c2f323c')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe5315fe-1f, col_values=(('external_ids', {'iface-id': 'be5315fe-1fc2-4a50-bfd7-61b664930081', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:36:aa', 'vm-uuid': 'f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:09 user nova-compute[75051]: INFO os_vif [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f')
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] No VIF found with MAC fa:16:3e:d4:36:aa, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Updated VIF entry in instance network info cache for port be5315fe-1fc2-4a50-bfd7-61b664930081. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Updating instance_info_cache with network_info: [{"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6830ecd-9253-41b3-8509-b3e418b8d884 req-86b63019-88eb-4e41-83a4-bdac4baa8428 service nova] Releasing lock "refresh_cache-f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Successfully created port: b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:56:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'flavor' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Successfully updated port: b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-changed-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Refreshing instance network info cache due to event network-changed-b98940b3-11d3-4f74-b474-3ad878481c60. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:11 user nova-compute[75051]: INFO nova.compute.manager [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attaching volume ef5c1d56-3b89-45fc-95a6-2c8691784a48 to /dev/vdb
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.utils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[526c6508-b00e-4433-b155-c4219eb67b03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b169e5d-a05d-4337-91ab-48ff30dec5e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3898af6e-61d3-4179-ba6d-0328b1ca7cc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1319325a-d7ff-44c4-95ce-04a67d8ead6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:11 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d367801-b201-42ef-911a-5056352001c5]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG os_brick.utils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating existing volume attachment record: 757bd440-f451-46af-9044-6642b6067954 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:11 user nova-compute[75051]: INFO nova.compute.manager [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Terminating instance
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance network_info: |[{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Refreshing network info cache for port b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-unplugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-unplugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-40ea4460-6b09-4423-9500-7af135fc431c req-43251482-01f9-4095-a334-eab7843a5748 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-unplugged-100a87c1-4a68-4946-a293-96ace9269687 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:56:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updated VIF entry in instance network info cache for port b98940b3-11d3-4f74-b474-3ad878481c60. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-05c2f567-b9c1-441e-afcd-fca7ff7322d7 req-006a13cd-1349-4be5-a5e3-973c2ad3a9f7 service nova] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:12 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Instance destroyed successfully.
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lazy-loading 'resources' on Instance uuid 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-24T18:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-304976420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-304976420',id=8,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNHzR+0QAD0CS+dQrBoHBFqF/P/BRwNnJdUbODeq0JnDuRzO4WisWrIywaua5LtT2e+T3bgUWoQJm/VH2Ta6x1pcW8wMhpgd6k9t9jK4G2T3+sRhFptEciigpDZ2VzuIA==',key_name='tempest-keypair-1086392638',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1977597f2a324ed4ba4ca3794b12957f',ramdisk_id='',reservation_id='r-l60c13t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-374653462',owner_user_name='tempest-TaggedAttachmentsTest-374653462-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='acd941243b164658bf180f3c31cb732d',uuid=197a4531-4f1f-40b1-b8b9-03a2ad5e47bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converting VIF {"id": "100a87c1-4a68-4946-a293-96ace9269687", "address": "fa:16:3e:6b:7b:1b", "network": {"id": "bc32e2f8-16aa-4720-83ee-59ff0dbb9588", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-390218395-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1977597f2a324ed4ba4ca3794b12957f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap100a87c1-4a", "ovs_interfaceid": "100a87c1-4a68-4946-a293-96ace9269687", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG os_vif [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap100a87c1-4a, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3a0b616-9ae3-4955-8114-976f40bbe8f7) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:12 user nova-compute[75051]: INFO os_vif [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7b:1b,bridge_name='br-int',has_traffic_filtering=True,id=100a87c1-4a68-4946-a293-96ace9269687,network=Network(bc32e2f8-16aa-4720-83ee-59ff0dbb9588),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap100a87c1-4a')
Nov 24 18:56:12 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Deleting instance files /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd_del
Nov 24 18:56:12 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Deletion of /opt/stack/data/nova/instances/197a4531-4f1f-40b1-b8b9-03a2ad5e47bd_del complete
Nov 24 18:56:12 user nova-compute[75051]: INFO nova.compute.manager [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 24 18:56:12 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:56:12 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] No waiting events found dispatching network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:13 user nova-compute[75051]: WARNING nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received unexpected event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 for instance with vm_state building and task_state spawning.
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] No waiting events found dispatching network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:13 user nova-compute[75051]: WARNING nova.compute.manager [req-42b25931-b03f-4b31-b4ed-a0022b02ad13 req-794f9b54-c405-4a27-8166-acc9b2a59566 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received unexpected event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 for instance with vm_state building and task_state spawning.
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:13 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:13 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:13 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b3c487-ce8b-4cb9-99e5-dfd546842981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:56:13 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b89f3e-6c0c-44f7-8c12-8764e95e9980]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.096s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d86c7a-7a95-4e58-823b-c64b4c03b120]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.114s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06161ea3-209a-4d21-9693-94804e40df35]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo" returned: 0 in 0.071s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[867cfc27-978d-45f8-b4b0-1d42287aa6a5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKhJRxIo'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d52d2-5387-4e07-8fde-037858c15622]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab21ad1-5c8c-4925-8f02-8674f69ec63a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:13 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Took 1.13 seconds to deallocate network for instance.
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f1985c-aea9-42df-9293-da880db48b25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 18:56:13 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a403774-1851-48d5-824e-36074994b212]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:56:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Instance spawned successfully.
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8270703-66e3-419d-bdf6-48777bb5ce5f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:13 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:13 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.554s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1c7b9-7460-482c-8675-60882e95dc43]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] Acquiring lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] No waiting events found dispatching network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:14 user nova-compute[75051]: WARNING nova.compute.manager [req-27798902-a330-426e-a147-cfd61ff05d21 req-a5f46104-c926-4f05-947d-796163f5cda0 service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received unexpected event network-vif-plugged-100a87c1-4a68-4946-a293-96ace9269687 for instance with vm_state deleted and task_state None.
Nov 24 18:56:14 user nova-compute[75051]: INFO nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:56:14 user nova-compute[75051]: INFO nova.compute.manager [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Took 8.57 seconds to build instance.
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee49bcb2-f711-4908-bad7-64f89ee823ca tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.751s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:14 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Deleted allocations for instance 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad2d9043-8444-4d93-9ccc-56ea31abe573 tempest-TaggedAttachmentsTest-374653462 tempest-TaggedAttachmentsTest-374653462-project-member] Lock "197a4531-4f1f-40b1-b8b9-03a2ad5e47bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.855s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:14 user nova-compute[75051]: INFO nova.compute.manager [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Terminating instance
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG os_brick.utils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9c3c1d-6e41-4ad0-912e-8381e144ce7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.617s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== connect_volume: return (1619ms) {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b70fec4-2f7a-465b-90c3-e4b2fcd89933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'flavor' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d80786-836c-4dec-9d7f-43f944f8bcba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b2f725-146d-472d-a672-0b2ba11b3cd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:56:15 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:15 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 18:56:15 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:56:15 user nova-compute[75051]:   <serial>ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac</serial>
Nov 24 18:56:15 user nova-compute[75051]: </disk>
Nov 24 18:56:15 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:15 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0f0ee5-aceb-4602-b385-b58cf2bfd42d]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_brick.utils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating existing volume attachment record: b9c91f44-c6ce-4a29-a51c-dc096fe4db9e {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: 197a4531-4f1f-40b1-b8b9-03a2ad5e47bd] Received event network-vif-deleted-100a87c1-4a68-4946-a293-96ace9269687 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-unplugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] No waiting events found dispatching network-vif-unplugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-unplugged-d7abb801-e462-4749-8349-13f953f5d61b for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Acquiring lock "f0410591-5d5c-473a-93a9-283730abc348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] Lock "f0410591-5d5c-473a-93a9-283730abc348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] No waiting events found dispatching network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:15 user nova-compute[75051]: WARNING nova.compute.manager [req-4ad39f8c-ed96-4a9f-9dc2-fc6d208a1bf7 req-8f449185-f4e1-41e0-be68-730fe2af6c2e service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received unexpected event network-vif-plugged-d7abb801-e462-4749-8349-13f953f5d61b for instance with vm_state active and task_state deleting.
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No VIF found with MAC fa:16:3e:84:5f:4d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5aa3633b-5fbf-4761-93a2-21d425554d49 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.975s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] Instance destroyed successfully.
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lazy-loading 'resources' on Instance uuid f0410591-5d5c-473a-93a9-283730abc348 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1780787285',display_name='tempest-TestVolumeSwap-server-1780787285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1780787285',id=6,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuc3dXEODIsjD1N+lB4qnDxsB96ThbmvHGUw/haqk1ovJMKxSredwzkFEVGQnJNpseVXW1drhrFZ7CwmrilhB4FghiTQJQVjaecDESNpcw78xvkoAs1alAbkY9eRtlJqw==',key_name='tempest-keypair-1587869462',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54c56b6e4e2747a79682208777045231',ramdisk_id='',reservation_id='r-plzo3x3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1784958988',owner_user_name='tempest-TestVolumeSwap-1784958988-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:53:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14001a6e46b9400b83132cdcca29e31f',uuid=f0410591-5d5c-473a-93a9-283730abc348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converting VIF {"id": "d7abb801-e462-4749-8349-13f953f5d61b", "address": "fa:16:3e:70:1e:f0", "network": {"id": "a23f0ce0-3596-4a09-9b39-26b6bab386e7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-125230050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54c56b6e4e2747a79682208777045231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7abb801-e4", "ovs_interfaceid": "d7abb801-e462-4749-8349-13f953f5d61b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG os_vif [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7abb801-e4, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dffc9ae-bc82-44fd-bee2-a29a86303b16) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:15 user nova-compute[75051]: INFO os_vif [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:1e:f0,bridge_name='br-int',has_traffic_filtering=True,id=d7abb801-e462-4749-8349-13f953f5d61b,network=Network(a23f0ce0-3596-4a09-9b39-26b6bab386e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7abb801-e4')
Nov 24 18:56:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Deleting instance files /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348_del
Nov 24 18:56:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Deletion of /opt/stack/data/nova/instances/f0410591-5d5c-473a-93a9-283730abc348_del complete
Nov 24 18:56:16 user nova-compute[75051]: INFO nova.compute.manager [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] [instance: f0410591-5d5c-473a-93a9-283730abc348] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 24 18:56:16 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:56:16 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:56:16 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:56:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:17 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: f0410591-5d5c-473a-93a9-283730abc348] Took 1.31 seconds to deallocate network for instance.
Nov 24 18:56:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-765c7198-36e2-4525-bc76-54f51d602b4b req-fa2c8e54-98c9-4cca-9ea4-62053a68b405 service nova] [instance: f0410591-5d5c-473a-93a9-283730abc348] Received event network-vif-deleted-d7abb801-e462-4749-8349-13f953f5d61b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:17 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Deleted allocations for instance f0410591-5d5c-473a-93a9-283730abc348
Nov 24 18:56:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a955f3e8-e24b-44fc-aca3-6c8a7604237d tempest-TestVolumeSwap-1784958988 tempest-TestVolumeSwap-1784958988-project-member] Lock "f0410591-5d5c-473a-93a9-283730abc348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Stashing vm_state: active {{(pid=75051) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:56:19 user nova-compute[75051]: INFO nova.compute.claims [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Claim successful on node user
Nov 24 18:56:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:19 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:19 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:19 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21217317-ecd9-46bd-98ab-600ab6560c66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:56:19 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating resource usage from migration 1d9b8905-9432-4935-93e3-a6c38a2e9044
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a04e0d9-355a-4293-a72e-f85fb50e8324]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48] added
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62288282-04fc-499f-8288-28333cfd4d68]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd83e6-6042-485e-90db-84708fb307b3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRIKPvUu {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRIKPvUu" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234e3f3-0ec7-485c-8b0d-97926e16af24]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRIKPvUu'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c1952a-0bed-435b-973e-63b3b25ac34a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31acbb6-c5cb-445a-b1ab-0aade109cb64]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5bacdd-6252-4faa-a282-cdbb345c4ba5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260]
Nov 24 18:56:19 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4743afe6-f5af-45ac-b391-2dbde643b070]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22faf8c-ae2f-4339-991a-8fc39e562fd9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:19 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[911faa0e-a38e-4593-bb21-c80520af441f]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.567s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:19 user nova-compute[75051]: INFO nova.compute.manager [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Migrating
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:19 user nova-compute[75051]: INFO nova.compute.rpcapi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:19 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-changed-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Refreshing instance network info cache due to event network-changed-8885bff7-e697-40e4-a3e9-e31a53583e3c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] Acquiring lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] Acquired lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.network.neutron [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Refreshing network info cache for port 8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Ignoring supplied device name: /dev/vdb
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23937343862303363', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937343862303363', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'flavor' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:56:20 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:20 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:56:20 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:56:20 user nova-compute[75051]:   <serial>ef5c1d56-3b89-45fc-95a6-2c8691784a48</serial>
Nov 24 18:56:20 user nova-compute[75051]: </disk>
Nov 24 18:56:20 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:20 user nova-compute[75051]: INFO nova.compute.manager [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Attaching volume 169dfaf0-ba75-4895-b607-5fc82f571fa2 to /dev/vdb
Nov 24 18:56:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG os_brick.utils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32d4eb-6225-4957-84ab-22e93eb754f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b743f-ab69-475f-8a09-b60f3259d6c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbde897-d8e4-46fd-9a24-73ca0ec9cdc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4999272-8c64-4eaa-b008-e464786b3f63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:21 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b6bda-6f7a-4422-a9c8-86402d7fb0e7]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG os_brick.utils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updating existing volume attachment record: 81bdf410-fd35-4952-ada8-f0454b177629 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No VIF found with MAC fa:16:3e:b9:41:3d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Starting migrate_disk_and_power_off {{(pid=75051) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.network.neutron [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updated VIF entry in instance network info cache for port 8885bff7-e697-40e4-a3e9-e31a53583e3c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG nova.network.neutron [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updating instance_info_cache with network_info: [{"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-282a316d-8ecd-41da-ba2c-3c1fe997e493 req-35ab613a-ff03-4e21-8186-ce770e4dbf5d service nova] Releasing lock "refresh_cache-1ee44d98-b374-4d33-add8-d55fc15309cc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2466c5f0-b275-47b5-8bd0-fdee458c890a tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.175s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:22 user nova-compute[75051]: WARNING nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:22 user nova-compute[75051]: WARNING nova.compute.manager [req-5d620c1f-b6ce-4e25-aa4c-f03a260a818d req-8d0583cf-3d76-4ea5-b62b-d4490f053e7c service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance destroyed successfully.
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3477becc-b1, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04184713-4a5e-4e11-af55-738387460df4) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: INFO os_vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:22 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.009s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.069s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e7367e-13bc-46b5-ac4f-ec69c7142562]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:56:22 user nova-compute[75051]: No targets found.
Nov 24 18:56:22 user nova-compute[75051]: iSNS:
Nov 24 18:56:22 user nova-compute[75051]: No targets found.
Nov 24 18:56:22 user nova-compute[75051]: STATIC:
Nov 24 18:56:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:56:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:56:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:22 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:56:22 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:22 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:22 user nova-compute[75051]: FIRMWARE:
Nov 24 18:56:22 user nova-compute[75051]: No targets found.
Nov 24 18:56:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:56:22 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:56:22 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf295242-0f22-4299-9969-f40f458a6e22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59caaf5-d92e-42a6-87b9-663600417f80]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:22 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:22 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:22 user nova-compute[75051]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:22 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0426f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bcdfce-ef0f-4476-9ee4-9418dc44e2c6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5890da6-1eeb-4926-acaf-95278d9a3f88]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c2203-d354-42b2-a55c-979c1565b3ab]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0374f5cf-3442-4123-9b8a-fd4f07cb86f3]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00a1e1-e9b1-4d1e-9396-1ed41de8933b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:56:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Creating image(s)
Nov 24 18:56:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Ensure instance console log exists: /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start _get_guest_xml network_info=[{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71e108a3-b5c9-4ffa-ad9c-21597ebc43df', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'serial': 'fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'b9c91f44-c6ce-4a29-a51c-dc096fe4db9e', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c5336-2d6e-48bd-b23b-809c7caa0099]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 18:56:23 user nova-compute[75051]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:23 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecf8d93-6971-4a94-bac0-edaffb0e97a9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.545s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== disconnect_volume: return (554ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:23 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:23 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedaece8-043d-4d94-8115-10843638d141]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:56:23 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb53324-7c4c-4a2f-b4f0-3b2ec8ed72ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4] added
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565f20b-8118-4e21-b02f-10004dc7547f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf042998-664d-4e1b-8da8-ab3215cb2632]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTuyGqie {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTuyGqie" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4878f9-0be1-46d6-a566-ee134fd944fe]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTuyGqie'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c79210-b851-4871-819c-1b77901ffee0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf88da2-6f12-4f67-84c1-a0180f212f10]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: INFO nova.compute.manager [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Rescuing
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0fa32e-3d9c-408d-a670-d0052467c98b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260]
Nov 24 18:56:23 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b3a34-9743-4cf9-9531-29dc34473f33]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a9928e-4344-435b-87ca-2689e3304e1f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.531s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_resize/disk /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a798a7e-65b1-4c2d-975d-0ee985de374e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "cp -r /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_resize/disk /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk" returned: 0 in 0.382s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_resize/disk.info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk.info {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "cp -r /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_resize/disk.info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk.info" returned: 0 in 0.048s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:24 user nova-compute[75051]: WARNING nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:24 user nova-compute[75051]: WARNING nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:24 user nova-compute[75051]: WARNING nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:24 user nova-compute[75051]: WARNING nova.compute.manager [req-2a019217-1a21-42b6-bbeb-368d5cef796e req-2922cca0-42a5-4c92-81ff-d22edc77f659 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_migrating.
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.606s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== connect_volume: return (1611ms) {'type': 'block', 'scsi_wwn': '23732383365306664', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732383365306664', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928277371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928277371',id=14,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-9s0s0dbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:09Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=71e108a3-b5c9-4ffa-ad9c-21597ebc43df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.objects.instance [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:56:24 user nova-compute[75051]:   <uuid>71e108a3-b5c9-4ffa-ad9c-21597ebc43df</uuid>
Nov 24 18:56:24 user nova-compute[75051]:   <name>instance-0000000e</name>
Nov 24 18:56:24 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:56:24 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:56:24 user nova-compute[75051]:   <metadata>
Nov 24 18:56:24 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:56:24 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-928277371</nova:name>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:56:23</nova:creationTime>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:56:24 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:56:24 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:owner>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 18:56:24 user nova-compute[75051]:       </nova:owner>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:56:24 user nova-compute[75051]:       <nova:ports>
Nov 24 18:56:24 user nova-compute[75051]:         <nova:port uuid="b98940b3-11d3-4f74-b474-3ad878481c60">
Nov 24 18:56:24 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 18:56:24 user nova-compute[75051]:         </nova:port>
Nov 24 18:56:24 user nova-compute[75051]:       </nova:ports>
Nov 24 18:56:24 user nova-compute[75051]:     </nova:instance>
Nov 24 18:56:24 user nova-compute[75051]:   </metadata>
Nov 24 18:56:24 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:56:24 user nova-compute[75051]:     <system>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="serial">71e108a3-b5c9-4ffa-ad9c-21597ebc43df</entry>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="uuid">71e108a3-b5c9-4ffa-ad9c-21597ebc43df</entry>
Nov 24 18:56:24 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:56:24 user nova-compute[75051]:     </system>
Nov 24 18:56:24 user nova-compute[75051]:   </sysinfo>
Nov 24 18:56:24 user nova-compute[75051]:   <os>
Nov 24 18:56:24 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:56:24 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:56:24 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:56:24 user nova-compute[75051]:   </os>
Nov 24 18:56:24 user nova-compute[75051]:   <features>
Nov 24 18:56:24 user nova-compute[75051]:     <acpi/>
Nov 24 18:56:24 user nova-compute[75051]:     <apic/>
Nov 24 18:56:24 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:56:24 user nova-compute[75051]:   </features>
Nov 24 18:56:24 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:56:24 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:56:24 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:56:24 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:56:24 user nova-compute[75051]:   </clock>
Nov 24 18:56:24 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:56:24 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:56:24 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:56:24 user nova-compute[75051]:   </cpu>
Nov 24 18:56:24 user nova-compute[75051]:   <devices>
Nov 24 18:56:24 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:56:24 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:24 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 18:56:24 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:56:24 user nova-compute[75051]:       <serial>fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4</serial>
Nov 24 18:56:24 user nova-compute[75051]:     </disk>
Nov 24 18:56:24 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:56:24 user nova-compute[75051]:       <mac address="fa:16:3e:74:ea:25"/>
Nov 24 18:56:24 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:24 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:56:24 user nova-compute[75051]:       <target dev="tapb98940b3-11"/>
Nov 24 18:56:24 user nova-compute[75051]:     </interface>
Nov 24 18:56:24 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:56:24 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/console.log" append="off"/>
Nov 24 18:56:24 user nova-compute[75051]:     </serial>
Nov 24 18:56:24 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:56:24 user nova-compute[75051]:     <video>
Nov 24 18:56:24 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:24 user nova-compute[75051]:     </video>
Nov 24 18:56:24 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:56:24 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:56:24 user nova-compute[75051]:     </rng>
Nov 24 18:56:24 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:56:24 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:56:24 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:56:24 user nova-compute[75051]:     </memballoon>
Nov 24 18:56:24 user nova-compute[75051]:   </devices>
Nov 24 18:56:24 user nova-compute[75051]: </domain>
Nov 24 18:56:24 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928277371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928277371',id=14,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-9s0s0dbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:09Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=71e108a3-b5c9-4ffa-ad9c-21597ebc43df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG os_vif [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8552524a-8a1b-5765-8511-96dc9db048f6', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb98940b3-11, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb98940b3-11, col_values=(('qos', UUID('7be47e12-264e-4fa8-a612-e1584297305d')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb98940b3-11, col_values=(('external_ids', {'iface-id': 'b98940b3-11d3-4f74-b474-3ad878481c60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:ea:25', 'vm-uuid': '71e108a3-b5c9-4ffa-ad9c-21597ebc43df'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:24 user nova-compute[75051]: INFO os_vif [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11')
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:74:ea:25, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Port 3477becc-b128-4274-84c5-37633e88d5eb binding to destination host user is already ACTIVE {{(pid=75051) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance destroyed successfully.
Nov 24 18:56:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attempting a stable device rescue
Nov 24 18:56:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 18:56:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Creating image(s)
Nov 24 18:56:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "036fe78e26ce14bd357fc5ae2471d7199f482300" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "036fe78e26ce14bd357fc5ae2471d7199f482300" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:27 user nova-compute[75051]: WARNING nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state rescuing.
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:27 user nova-compute[75051]: WARNING nova.compute.manager [req-fb88691e-ba48-470f-8410-5aca49d4c3af req-874fd925-c97b-4757-9eb3-f1ed2f47d28b service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state rescuing.
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.part --force-share --output=json" returned: 0 in 0.237s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.virt.images [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] 7deaf668-eca1-4af1-a438-1c04e1ad3c56 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.part /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG os_brick.utils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d36d8-5153-414d-acad-417ef3e6a657]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2880e56b-1420-4b2f-b9ea-56a6c70b85f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2da9ca9-31ed-4c14-a4ec-3e42590a09fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d72651-63d9-4dfe-b7f8-00e1cd24f5cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[503db850-665f-4078-8a91-0805c2d54c8f]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.utils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== get_connector_properties: return (394ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.part /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.converted" returned: 0 in 0.561s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "036fe78e26ce14bd357fc5ae2471d7199f482300" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.389s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "036fe78e26ce14bd357fc5ae2471d7199f482300" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "036fe78e26ce14bd357fc5ae2471d7199f482300" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state building and task_state spawning.
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING nova.compute.manager [req-134538a2-d8fc-42f4-b655-9596a375124f req-565b6250-7a26-49f9-b996-4bea91581b2b service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state building and task_state spawning.
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300 --force-share --output=json" returned: 0 in 0.208s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300,backing_fmt=raw /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300,backing_fmt=raw /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue" returned: 0 in 0.062s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "036fe78e26ce14bd357fc5ae2471d7199f482300" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'migration_context' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Object Instance<4667ca1f-edc2-49d3-a2d0-3112bf186a1d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start _get_guest_xml network_info=[{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "vif_mac": "fa:16:3e:b9:41:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7deaf668-eca1-4af1-a438-1c04e1ad3c56', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4667ca1f-edc2-49d3-a2d0-3112bf186a1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'serial': 'ef5c1d56-3b89-45fc-95a6-2c8691784a48'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '757bd440-f451-46af-9044-6642b6067954', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'resources' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Object Instance<4667ca1f-edc2-49d3-a2d0-3112bf186a1d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'numa_topology' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Object Instance<4667ca1f-edc2-49d3-a2d0-3112bf186a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgbmZsUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:28 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d022a92-a6d5-45f1-ad51-4dc061071f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:56:28 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:28 user nova-compute[75051]: DEBUG nova.objects.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Object Instance<4667ca1f-edc2-49d3-a2d0-3112bf186a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:29 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efb77cd-d5fa-475d-b1e4-0aa9b01c6382]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2] added
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedd4355-078f-42c9-a93a-1d4cf8f57403]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[19042f5d-6315-448c-9e0d-69d602d29abf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgbmZsUl {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QgbmZsUl" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c235fd-fb72-4c4f-bff5-8d4c6db04642]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QgbmZsUl'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ae8cea-9277-4535-b832-a97b90440829]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76967f9-9bd7-45f7-ab4b-d009ef5b4400]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b381883a-0e0c-42a9-a20f-49b3b35f7d71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260]
Nov 24 18:56:29 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e129ac-72ed-4972-9d28-b53c1b9ea501]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4f405d-514e-4444-861e-4120dc1e9ebf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da4807-fb31-4cdd-87ee-38653031c5ac]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgbmZsUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:56:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance spawned successfully.
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23532613765633731', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532613765633731', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.332s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:30 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:30 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.objects.instance [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7edb804-8cbb-4375-ac2d-2c70dbd409d6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GRIKPvUu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 18:56:30 user nova-compute[75051]: node.name = iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:56:30 user nova-compute[75051]: node.tpgt = -1
Nov 24 18:56:30 user nova-compute[75051]: node.startup = automatic
Nov 24 18:56:30 user nova-compute[75051]: node.leading_login = No
Nov 24 18:56:30 user nova-compute[75051]: iface.iscsi_ifacename = default
Nov 24 18:56:30 user nova-compute[75051]: iface.net_ifacename = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.ipaddress = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.prefix_len = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.hwaddress = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.transport_name = tcp
Nov 24 18:56:30 user nova-compute[75051]: iface.initiatorname = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.vlan_id = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.vlan_priority = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.vlan_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.iface_num = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.mtu = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.port = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.bootproto = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.subnet_mask = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.gateway = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_alt_client_id = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_dns = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_learn_iqn = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_vendor_id_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_vendor_id = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.dhcp_slp_da = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.fragmentation = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.gratuitous_arp = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.incoming_forwarding = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.tos_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.tos = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.ttl = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.delayed_ack = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.tcp_nagle = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.tcp_wsf_state = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.tcp_wsf = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.tcp_timer_scale = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.tcp_timestamp = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.redirect = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.def_task_mgmt_timeout = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.header_digest = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.data_digest = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.immediate_data = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.initial_r2t = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.data_seq_inorder = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.data_pdu_inorder = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.erl = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.max_receive_data_len = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.first_burst_len = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.max_outstanding_r2t = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.max_burst_len = 0
Nov 24 18:56:30 user nova-compute[75051]: iface.chap_auth = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.bidi_chap = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.strict_login_compliance = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.discovery_auth = <empty>
Nov 24 18:56:30 user nova-compute[75051]: iface.discovery_logout = <empty>
Nov 24 18:56:30 user nova-compute[75051]: node.discovery_address = <empty>
Nov 24 18:56:30 user nova-compute[75051]: node.discovery_port = 0
Nov 24 18:56:30 user nova-compute[75051]: node.discovery_type = static
Nov 24 18:56:30 user nova-compute[75051]: node.session.initial_cmdsn = 0
Nov 24 18:56:30 user nova-compute[75051]: node.session.initial_login_retry_max = 8
Nov 24 18:56:30 user nova-compute[75051]: node.session.xmit_thread_priority = -20
Nov 24 18:56:30 user nova-compute[75051]: node.session.cmds_max = 128
Nov 24 18:56:30 user nova-compute[75051]: node.session.queue_depth = 32
Nov 24 18:56:30 user nova-compute[75051]: node.session.nr_sessions = 1
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.authmethod = CHAP
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.username = GRIKPvUu
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.password = ***
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.username_in = <empty>
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.password_in = <empty>
Nov 24 18:56:30 user nova-compute[75051]: node.session.auth.chap_algs = MD5
Nov 24 18:56:30 user nova-compute[75051]: node.session.timeo.replacement_timeout = 120
Nov 24 18:56:30 user nova-compute[75051]: node.session.err_timeo.abort_timeout = 15
Nov 24 18:56:30 user nova-compute[75051]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 18:56:30 user nova-compute[75051]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 18:56:30 user nova-compute[75051]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.FastAbort = Yes
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.InitialR2T = No
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.ImmediateData = Yes
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.MaxConnections = 1
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 18:56:30 user nova-compute[75051]: node.session.iscsi.ERL = 0
Nov 24 18:56:30 user nova-compute[75051]: node.session.scan = manual
Nov 24 18:56:30 user nova-compute[75051]: node.session.reopen_max = 0
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].address = 172.16.0.220
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].port = 3260
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].startup = manual
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].tcp.window_size = 524288
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].tcp.type_of_service = 0
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].timeo.logout_timeout = 15
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].timeo.login_timeout = 15
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].timeo.auth_timeout = 45
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.DataDigest = None
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.IFMarker = No
Nov 24 18:56:30 user nova-compute[75051]: node.conn[0].iscsi.OFMarker = No
Nov 24 18:56:30 user nova-compute[75051]: # END RECORD
Nov 24 18:56:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc484a-e267-4959-a54d-755b5607bc36]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:56:30 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:30 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 18:56:30 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:   <serial>169dfaf0-ba75-4895-b607-5fc82f571fa2</serial>
Nov 24 18:56:30 user nova-compute[75051]: </disk>
Nov 24 18:56:30 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c820bd8d-294b-49df-ad92-9a415cd8d074]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRIKPvUu {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: INFO nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Took 7.47 seconds to spawn the instance on the hypervisor.
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRIKPvUu" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f816477-cc6d-4385-b441-a57ec0213e49]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRIKPvUu'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2650d15-0614-4144-8341-beab3b136f16]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa36bd3-a842-4e7a-bdfe-b1b070455c5b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.191s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] HCTL ('34', '0', '0', 0) found on session 19 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[052c844f-2039-414d-902a-d0f457275d60]: (4, ('0 0 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Searching for a device in session 19 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.217s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] <== connect_volume: return (1549ms) {'type': 'block', 'scsi_wwn': '23937343862303363', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937343862303363', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1631843319',display_name='tempest-ServerStableDeviceRescueTest-server-1631843319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1631843319',id=4,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp6SKZOIk+xReUl8mqhN/wc+R9+FUSmRXe8SoZ5JpOd1MFMSYZgsTsZKQs9P3kqS/r0bz/IP7rh+BDsdP1qH9x/syg2R/G2CIjxRgK03I7wiQ4OP1cOL3umm3BIS5g18w==',key_name='tempest-keypair-991358245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fa4b8bd2840427cbbc401ebe27fd1ef',ramdisk_id='',reservation_id='r-4cvaj118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1493484384',owner_user_name='tempest-ServerStableDeviceRescueTest-1493484384-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53abab4c5b7b48e0a4a857472ed46245',uuid=4667ca1f-edc2-49d3-a2d0-3112bf186a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "vif_mac": "fa:16:3e:b9:41:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converting VIF {"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "vif_mac": "fa:16:3e:b9:41:3d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'pci_devices' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:30 user nova-compute[75051]: INFO nova.compute.manager [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Took 22.44 seconds to build instance.
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.objects.base [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Object Instance<4667ca1f-edc2-49d3-a2d0-3112bf186a1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:56:30 user nova-compute[75051]:   <uuid>4667ca1f-edc2-49d3-a2d0-3112bf186a1d</uuid>
Nov 24 18:56:30 user nova-compute[75051]:   <name>instance-00000004</name>
Nov 24 18:56:30 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:56:30 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:56:30 user nova-compute[75051]:   <metadata>
Nov 24 18:56:30 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:56:30 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1631843319</nova:name>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:56:28</nova:creationTime>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:56:30 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:56:30 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:owner>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:user uuid="53abab4c5b7b48e0a4a857472ed46245">tempest-ServerStableDeviceRescueTest-1493484384-project-member</nova:user>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:project uuid="2fa4b8bd2840427cbbc401ebe27fd1ef">tempest-ServerStableDeviceRescueTest-1493484384</nova:project>
Nov 24 18:56:30 user nova-compute[75051]:       </nova:owner>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:56:30 user nova-compute[75051]:       <nova:ports>
Nov 24 18:56:30 user nova-compute[75051]:         <nova:port uuid="b24c4402-fb02-4205-9ee8-d414e41210ea">
Nov 24 18:56:30 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 18:56:30 user nova-compute[75051]:         </nova:port>
Nov 24 18:56:30 user nova-compute[75051]:       </nova:ports>
Nov 24 18:56:30 user nova-compute[75051]:     </nova:instance>
Nov 24 18:56:30 user nova-compute[75051]:   </metadata>
Nov 24 18:56:30 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:56:30 user nova-compute[75051]:     <system>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="serial">4667ca1f-edc2-49d3-a2d0-3112bf186a1d</entry>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="uuid">4667ca1f-edc2-49d3-a2d0-3112bf186a1d</entry>
Nov 24 18:56:30 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:56:30 user nova-compute[75051]:     </system>
Nov 24 18:56:30 user nova-compute[75051]:   </sysinfo>
Nov 24 18:56:30 user nova-compute[75051]:   <os>
Nov 24 18:56:30 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:56:30 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:56:30 user nova-compute[75051]:   </os>
Nov 24 18:56:30 user nova-compute[75051]:   <features>
Nov 24 18:56:30 user nova-compute[75051]:     <acpi/>
Nov 24 18:56:30 user nova-compute[75051]:     <apic/>
Nov 24 18:56:30 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:56:30 user nova-compute[75051]:   </features>
Nov 24 18:56:30 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:56:30 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:56:30 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:56:30 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:56:30 user nova-compute[75051]:   </clock>
Nov 24 18:56:30 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:56:30 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:56:30 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:56:30 user nova-compute[75051]:   </cpu>
Nov 24 18:56:30 user nova-compute[75051]:   <devices>
Nov 24 18:56:30 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:56:30 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:56:30 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk"/>
Nov 24 18:56:30 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:     </disk>
Nov 24 18:56:30 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:56:30 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:30 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 18:56:30 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:       <serial>ef5c1d56-3b89-45fc-95a6-2c8691784a48</serial>
Nov 24 18:56:30 user nova-compute[75051]:     </disk>
Nov 24 18:56:30 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:56:30 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:56:30 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue"/>
Nov 24 18:56:30 user nova-compute[75051]:       <target dev="vdc" bus="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:       <boot order="1"/>
Nov 24 18:56:30 user nova-compute[75051]:     </disk>
Nov 24 18:56:30 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:56:30 user nova-compute[75051]:       <mac address="fa:16:3e:b9:41:3d"/>
Nov 24 18:56:30 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:56:30 user nova-compute[75051]:       <target dev="tapb24c4402-fb"/>
Nov 24 18:56:30 user nova-compute[75051]:     </interface>
Nov 24 18:56:30 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:56:30 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/console.log" append="off"/>
Nov 24 18:56:30 user nova-compute[75051]:     </serial>
Nov 24 18:56:30 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:56:30 user nova-compute[75051]:     <video>
Nov 24 18:56:30 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:30 user nova-compute[75051]:     </video>
Nov 24 18:56:30 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:56:30 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:56:30 user nova-compute[75051]:     </rng>
Nov 24 18:56:30 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:56:30 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:56:30 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:56:30 user nova-compute[75051]:     </memballoon>
Nov 24 18:56:30 user nova-compute[75051]:   </devices>
Nov 24 18:56:30 user nova-compute[75051]: </domain>
Nov 24 18:56:30 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-993b1e8a-623e-4a0f-ad0f-ae0ad9f08765 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.039s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance destroyed successfully.
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] No VIF found with MAC fa:16:3e:b9:41:3d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No VIF found with MAC fa:16:3e:ea:66:39, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16e0973f-0fee-46e3-a769-bbf79ea8da0e tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.182s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:32 user nova-compute[75051]: WARNING nova.compute.manager [req-994592c3-105e-482c-8050-289d18a824a0 req-7daac2f7-357f-4971-8e5c-ee991f52c621 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state rescuing.
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:34 user nova-compute[75051]: WARNING nova.compute.manager [req-85c4cf6a-e4cf-40f3-a431-244dbe3b34b3 req-d4e4da28-279c-4a34-9463-e8e76309bcc2 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state active and task_state rescuing.
Nov 24 18:56:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e79626d6-fcae-4869-b207-f35ddcf87707 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Starting finish_migration {{(pid=75051) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 18:56:35 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Creating image(s)
Nov 24 18:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.245s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk. size=21474836480 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk 21474836480 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk 21474836480" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Ensure instance console log exists: /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start _get_guest_xml network_info=[{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '451ff98d-318a-4a05-a612-e3ce527d1164', 'attached_at': '2023-11-24T18:56:35.000000', 'detached_at': '', 'volume_id': 'ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'serial': 'ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '11f3a426-cf10-4910-b189-dfa090087c77', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:56:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:36 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:36 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:36 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[11020811-f612-4f75-bdbd-c218ce7ae5bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:56:36 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b9376-cd58-475f-b312-5f2d918c0f80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c210f86-33d2-4642-bc2e-a9a0e515a982]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[773545b9-72e0-4721-a439-5598aca166a7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b318982-4f33-40d7-93f7-0c8a730b0e5a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKhJRxIo'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e306f06b-b9a8-4283-9dff-9baa2cdd9d0f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290114c-22d1-4921-8c99-64906ab6ba96]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9da5af-c2a1-409d-beb4-c29186cab353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 18:56:36 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21702237-e02f-4b5c-8317-d1120af37682]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b60b5c-0331-4741-9e14-a93c634922dd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:36 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d6621-8db2-4e98-b730-79f851d3e343]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:56:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:56:37 user nova-compute[75051]:   <uuid>451ff98d-318a-4a05-a612-e3ce527d1164</uuid>
Nov 24 18:56:37 user nova-compute[75051]:   <name>instance-00000003</name>
Nov 24 18:56:37 user nova-compute[75051]:   <memory>2097152</memory>
Nov 24 18:56:37 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:56:37 user nova-compute[75051]:   <metadata>
Nov 24 18:56:37 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:56:37 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherB-server-1162642123</nova:name>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:56:36</nova:creationTime>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:flavor name="m1.small">
Nov 24 18:56:37 user nova-compute[75051]:         <nova:memory>2048</nova:memory>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:disk>20</nova:disk>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:56:37 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:owner>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:user uuid="5e4cb3329e664cf2b3452e4107df7060">tempest-ServerActionsTestOtherB-355305494-project-member</nova:user>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:project uuid="233bc8e889de4ee8b6a00050bee74931">tempest-ServerActionsTestOtherB-355305494</nova:project>
Nov 24 18:56:37 user nova-compute[75051]:       </nova:owner>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:56:37 user nova-compute[75051]:       <nova:ports>
Nov 24 18:56:37 user nova-compute[75051]:         <nova:port uuid="3477becc-b128-4274-84c5-37633e88d5eb">
Nov 24 18:56:37 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 18:56:37 user nova-compute[75051]:         </nova:port>
Nov 24 18:56:37 user nova-compute[75051]:       </nova:ports>
Nov 24 18:56:37 user nova-compute[75051]:     </nova:instance>
Nov 24 18:56:37 user nova-compute[75051]:   </metadata>
Nov 24 18:56:37 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:56:37 user nova-compute[75051]:     <system>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="serial">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="uuid">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:56:37 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:56:37 user nova-compute[75051]:     </system>
Nov 24 18:56:37 user nova-compute[75051]:   </sysinfo>
Nov 24 18:56:37 user nova-compute[75051]:   <os>
Nov 24 18:56:37 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:56:37 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:56:37 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:56:37 user nova-compute[75051]:   </os>
Nov 24 18:56:37 user nova-compute[75051]:   <features>
Nov 24 18:56:37 user nova-compute[75051]:     <acpi/>
Nov 24 18:56:37 user nova-compute[75051]:     <apic/>
Nov 24 18:56:37 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:56:37 user nova-compute[75051]:   </features>
Nov 24 18:56:37 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:56:37 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:56:37 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:56:37 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:56:37 user nova-compute[75051]:   </clock>
Nov 24 18:56:37 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:56:37 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:56:37 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:56:37 user nova-compute[75051]:   </cpu>
Nov 24 18:56:37 user nova-compute[75051]:   <devices>
Nov 24 18:56:37 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:56:37 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:56:37 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk"/>
Nov 24 18:56:37 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:56:37 user nova-compute[75051]:     </disk>
Nov 24 18:56:37 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:56:37 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:37 user nova-compute[75051]:       <source dev="/dev/sde"/>
Nov 24 18:56:37 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:56:37 user nova-compute[75051]:       <serial>ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac</serial>
Nov 24 18:56:37 user nova-compute[75051]:     </disk>
Nov 24 18:56:37 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:56:37 user nova-compute[75051]:       <mac address="fa:16:3e:84:5f:4d"/>
Nov 24 18:56:37 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:37 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:56:37 user nova-compute[75051]:       <target dev="tap3477becc-b1"/>
Nov 24 18:56:37 user nova-compute[75051]:     </interface>
Nov 24 18:56:37 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:56:37 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/console.log" append="off"/>
Nov 24 18:56:37 user nova-compute[75051]:     </serial>
Nov 24 18:56:37 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:56:37 user nova-compute[75051]:     <video>
Nov 24 18:56:37 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:37 user nova-compute[75051]:     </video>
Nov 24 18:56:37 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:56:37 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:56:37 user nova-compute[75051]:     </rng>
Nov 24 18:56:37 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:56:37 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:56:37 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:56:37 user nova-compute[75051]:     </memballoon>
Nov 24 18:56:37 user nova-compute[75051]:   </devices>
Nov 24 18:56:37 user nova-compute[75051]: </domain>
Nov 24 18:56:37 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-601829907-network", "vif_mac": "fa:16:3e:84:5f:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG os_vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd68b916f-616c-5b49-80cf-8a560c842f93', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3477becc-b1, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3477becc-b1, col_values=(('qos', UUID('2fcbd094-ec4d-4709-b1e4-ea7c3ea05103')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3477becc-b1, col_values=(('external_ids', {'iface-id': '3477becc-b128-4274-84c5-37633e88d5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:5f:4d', 'vm-uuid': '451ff98d-318a-4a05-a612-e3ce527d1164'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:37 user nova-compute[75051]: INFO os_vif [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] No VIF found with MAC fa:16:3e:84:5f:4d, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:39 user nova-compute[75051]: INFO nova.compute.manager [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Terminating instance
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-a0e84f06-742d-4d5b-b20a-3b747ab75fb2 req-8170a170-41fc-4925-b809-1e10ad7a21c5 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:39 user nova-compute[75051]: WARNING nova.compute.manager [req-79be84d8-04e6-47e0-8b7a-da069193682f req-7b0c278f-5dae-4994-afae-885e0efaf0b9 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_finish.
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Instance destroyed successfully.
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lazy-loading 'resources' on Instance uuid bec46576-e2b6-4bc9-8648-5cc341ac2144 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T18:52:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1692161129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-240118934',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0inHseC+7sucw36EoG1p2w1vBcoRUE8uoKoIhffts8Nw2Hf/zDq4w1KD3o79LrLwz/y1x5bTWJHctNlBdG45HDfI+vbgmyY4MPVqVQt6aGWzRBK/FrkyZ/OwcOr13ZA==',key_name='tempest-keypair-753940874',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:55:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cc9f240a45c840cb9715c2c608250d9f',ramdisk_id='',reservation_id='r-h55ocw7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-114400367',owner_user_name='tempest-ServerActionsV293TestJSON-114400367-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:55:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c302b95e8c240f78684448f37d317e2',uuid=bec46576-e2b6-4bc9-8648-5cc341ac2144,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converting VIF {"id": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "address": "fa:16:3e:6b:7c:d2", "network": {"id": "422697fd-783c-4874-b879-ebb8567b6592", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1813249606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cc9f240a45c840cb9715c2c608250d9f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfff62d2-06", "ovs_interfaceid": "cfff62d2-06f1-41c6-9394-7a02c1f328dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_vif [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfff62d2-06, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc7b8183-fcdc-43d1-9834-7b3d9fe68c94) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:40 user nova-compute[75051]: INFO os_vif [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=cfff62d2-06f1-41c6-9394-7a02c1f328dc,network=Network(422697fd-783c-4874-b879-ebb8567b6592),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfff62d2-06')
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDcxQVvm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:56:40 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[29314bb6-ff35-49c5-9f71-fda21da33f06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:56:40 user nova-compute[75051]: No targets found.
Nov 24 18:56:40 user nova-compute[75051]: iSNS:
Nov 24 18:56:40 user nova-compute[75051]: No targets found.
Nov 24 18:56:40 user nova-compute[75051]: STATIC:
Nov 24 18:56:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2
Nov 24 18:56:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:56:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724
Nov 24 18:56:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:56:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:56:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:56:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:56:40 user nova-compute[75051]: FIRMWARE:
Nov 24 18:56:40 user nova-compute[75051]: No targets found.
Nov 24 18:56:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:56:40 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:56:40 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e1d97-9af5-4560-9394-895d9e6f4e6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.070s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dc9836-93b5-46a2-a1ca-e8f7d1905d38]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:56:40 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:56:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a04244c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724'): ({'sdi'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Removing single pathed devices sdi {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b76e6-7cd1-40e2-a1ae-57eb45dcc33e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.039s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee08f58-30ad-40f8-b396-f5ee2e877bd6]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Flushing IO for device /dev/sdi {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58929340-ad98-4052-8b0b-7d7ec2ca2950]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b49d7c-724b-4ce9-9c7e-73d50ec48697]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] SCSI volumes sdi have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b32195-61a0-4d8b-a9c7-d059d5f15728]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff668d-5b06-4836-8499-d52f90e7d11c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260]
Nov 24 18:56:40 user nova-compute[75051]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724, portal: 172.16.0.220,3260] successful.
Nov 24 18:56:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c846ce81-0890-47e5-bd84-76f6b1817724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d1d017-bae7-4f59-b030-f20461aa2584]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] <== disconnect_volume: return (522ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:56:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deleting instance files /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144_del
Nov 24 18:56:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deletion of /opt/stack/data/nova/instances/bec46576-e2b6-4bc9-8648-5cc341ac2144_del complete
Nov 24 18:56:40 user nova-compute[75051]: INFO nova.compute.manager [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Took 1.93 seconds to destroy the instance on the hypervisor.
Nov 24 18:56:40 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:56:40 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: WARNING nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state deleting.
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: WARNING nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state deleting.
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: WARNING nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state deleting.
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-unplugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Acquiring lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] No waiting events found dispatching network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: WARNING nova.compute.manager [req-604eaa5b-8ab8-47a9-b4e1-c8ff721f5ef0 req-785c0f27-a4f9-47d5-ad02-a22744aaefbb service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received unexpected event network-vif-plugged-cfff62d2-06f1-41c6-9394-7a02c1f328dc for instance with vm_state active and task_state deleting.
Nov 24 18:56:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:41 user nova-compute[75051]: WARNING nova.compute.manager [req-5ee0ba93-cae4-4fde-a186-f023769d2707 req-72fd78d3-c1b2-45d3-8ba0-b3e1ae1d1585 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state resize_finish.
Nov 24 18:56:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:56:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance running successfully.
Nov 24 18:56:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Failed to set time: agent not configured {{(pid=75051) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 24 18:56:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c9d5a913-d636-47e7-a4a4-980386490838 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] finish_migration finished successfully. {{(pid=75051) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 24 18:56:43 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:43 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Took 2.06 seconds to deallocate network for instance.
Nov 24 18:56:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-ad2ac36e-1811-4e34-89aa-5abb299e1c6a req-280fe948-f762-4fb3-b7d6-a0c8b9e9f5f7 service nova] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Received event network-vif-deleted-cfff62d2-06f1-41c6-9394-7a02c1f328dc {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:44 user nova-compute[75051]: INFO nova.compute.manager [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Took 1.30 seconds to detach 1 volumes for instance.
Nov 24 18:56:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] [instance: bec46576-e2b6-4bc9-8648-5cc341ac2144] Deleting volume: c846ce81-0890-47e5-bd84-76f6b1817724 {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 18:56:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:44 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:44 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:45 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Deleted allocations for instance bec46576-e2b6-4bc9-8648-5cc341ac2144
Nov 24 18:56:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dd561d34-304b-4fc0-a51d-a0f76845e1d4 tempest-ServerActionsV293TestJSON-114400367 tempest-ServerActionsV293TestJSON-114400367-project-member] Lock "bec46576-e2b6-4bc9-8648-5cc341ac2144" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.163s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:56:48 user nova-compute[75051]: INFO nova.compute.claims [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Claim successful on node user
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:56:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:56:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG nova.policy [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1542a899903c40dfba0d4b274b547b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5e7665a994fe29c206c1b53c5359f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:56:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Creating image(s)
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "/opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.228s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.242s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk 1073741824" returned: 0 in 0.063s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:56:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Successfully created port: f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Cannot resize image /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Ensure instance console log exists: /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Successfully updated port: f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing instance network info cache due to event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Instance network_info: |[{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Start _get_guest_xml network_info=[{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:56:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1613468970',display_name='tempest-ServerActionsTestOtherA-server-1613468970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1613468970',id=15,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-fv3h0xhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=563ea966-1ba6-4c4d-9d01-c5293e2d6d19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'pci_devices' on Instance uuid 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:56:51 user nova-compute[75051]:   <uuid>563ea966-1ba6-4c4d-9d01-c5293e2d6d19</uuid>
Nov 24 18:56:51 user nova-compute[75051]:   <name>instance-0000000f</name>
Nov 24 18:56:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:56:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:56:51 user nova-compute[75051]:   <metadata>
Nov 24 18:56:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:56:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherA-server-1613468970</nova:name>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:56:51</nova:creationTime>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:56:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:56:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:owner>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:user uuid="1542a899903c40dfba0d4b274b547b73">tempest-ServerActionsTestOtherA-214702841-project-member</nova:user>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:project uuid="9ae5e7665a994fe29c206c1b53c5359f">tempest-ServerActionsTestOtherA-214702841</nova:project>
Nov 24 18:56:51 user nova-compute[75051]:       </nova:owner>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:56:51 user nova-compute[75051]:       <nova:ports>
Nov 24 18:56:51 user nova-compute[75051]:         <nova:port uuid="f1eb287e-95db-4df1-87fe-cf8738161dd5">
Nov 24 18:56:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 18:56:51 user nova-compute[75051]:         </nova:port>
Nov 24 18:56:51 user nova-compute[75051]:       </nova:ports>
Nov 24 18:56:51 user nova-compute[75051]:     </nova:instance>
Nov 24 18:56:51 user nova-compute[75051]:   </metadata>
Nov 24 18:56:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:56:51 user nova-compute[75051]:     <system>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="serial">563ea966-1ba6-4c4d-9d01-c5293e2d6d19</entry>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="uuid">563ea966-1ba6-4c4d-9d01-c5293e2d6d19</entry>
Nov 24 18:56:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:56:51 user nova-compute[75051]:     </system>
Nov 24 18:56:51 user nova-compute[75051]:   </sysinfo>
Nov 24 18:56:51 user nova-compute[75051]:   <os>
Nov 24 18:56:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:56:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:56:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:56:51 user nova-compute[75051]:   </os>
Nov 24 18:56:51 user nova-compute[75051]:   <features>
Nov 24 18:56:51 user nova-compute[75051]:     <acpi/>
Nov 24 18:56:51 user nova-compute[75051]:     <apic/>
Nov 24 18:56:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:56:51 user nova-compute[75051]:   </features>
Nov 24 18:56:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:56:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:56:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:56:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:56:51 user nova-compute[75051]:   </clock>
Nov 24 18:56:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:56:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:56:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:56:51 user nova-compute[75051]:   </cpu>
Nov 24 18:56:51 user nova-compute[75051]:   <devices>
Nov 24 18:56:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:56:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:56:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk"/>
Nov 24 18:56:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:56:51 user nova-compute[75051]:     </disk>
Nov 24 18:56:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:56:51 user nova-compute[75051]:       <mac address="fa:16:3e:ce:43:f2"/>
Nov 24 18:56:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:56:51 user nova-compute[75051]:       <target dev="tapf1eb287e-95"/>
Nov 24 18:56:51 user nova-compute[75051]:     </interface>
Nov 24 18:56:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:56:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/console.log" append="off"/>
Nov 24 18:56:51 user nova-compute[75051]:     </serial>
Nov 24 18:56:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:56:51 user nova-compute[75051]:     <video>
Nov 24 18:56:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:56:51 user nova-compute[75051]:     </video>
Nov 24 18:56:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:56:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:56:51 user nova-compute[75051]:     </rng>
Nov 24 18:56:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:56:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:56:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:56:51 user nova-compute[75051]:     </memballoon>
Nov 24 18:56:51 user nova-compute[75051]:   </devices>
Nov 24 18:56:51 user nova-compute[75051]: </domain>
Nov 24 18:56:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1613468970',display_name='tempest-ServerActionsTestOtherA-server-1613468970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1613468970',id=15,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-fv3h0xhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=563ea966-1ba6-4c4d-9d01-c5293e2d6d19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG os_vif [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0e872bc-bd76-57a2-b27a-0db7ed8f3a8d', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1eb287e-95, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1eb287e-95, col_values=(('qos', UUID('db41ea83-7f84-4f4b-8a39-f4cff901f872')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1eb287e-95, col_values=(('external_ids', {'iface-id': 'f1eb287e-95db-4df1-87fe-cf8738161dd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:43:f2', 'vm-uuid': '563ea966-1ba6-4c4d-9d01-c5293e2d6d19'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:51 user nova-compute[75051]: INFO os_vif [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95')
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:56:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:ce:43:f2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:56:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated VIF entry in instance network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:56:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:56:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37f89d38-889b-4903-ba79-b78dbb90026a req-8725509d-08e3-4da1-90b3-3bd6afb27168 service nova] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.028s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] No waiting events found dispatching network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:53 user nova-compute[75051]: WARNING nova.compute.manager [req-b9af5a1e-3243-46c3-a642-1509aa8bad89 req-6f6a6b87-b5d3-4eb1-a7d7-b02a39b73238 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received unexpected event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 for instance with vm_state building and task_state spawning.
Nov 24 18:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:56:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] No waiting events found dispatching network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:56:55 user nova-compute[75051]: WARNING nova.compute.manager [req-8ac9b8de-023f-4391-92ba-6525d36cf1ea req-e2890fdf-103b-410b-87ce-9184fefd0286 service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received unexpected event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 for instance with vm_state building and task_state spawning.
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:56:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Instance spawned successfully.
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:56:56 user nova-compute[75051]: INFO nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 24 18:56:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:56 user nova-compute[75051]: INFO nova.compute.manager [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Took 8.04 seconds to build instance.
Nov 24 18:56:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4da8c87c-de4f-4a9d-aa74-681c8c96511e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.209s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:57 user nova-compute[75051]: INFO nova.compute.manager [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Detaching volume 169dfaf0-ba75-4895-b607-5fc82f571fa2
Nov 24 18:56:57 user nova-compute[75051]: INFO nova.virt.block_device [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Attempting to driver detach volume 169dfaf0-ba75-4895-b607-5fc82f571fa2 from mountpoint /dev/vdb
Nov 24 18:56:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Attempting to detach device vdb from instance 1ee44d98-b374-4d33-add8-d55fc15309cc from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:56:57 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:57 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 18:56:57 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:56:57 user nova-compute[75051]:   <serial>169dfaf0-ba75-4895-b607-5fc82f571fa2</serial>
Nov 24 18:56:57 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:56:57 user nova-compute[75051]: </disk>
Nov 24 18:56:57 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:56:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully detached device vdb from instance 1ee44d98-b374-4d33-add8-d55fc15309cc from the persistent domain config.
Nov 24 18:56:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ee44d98-b374-4d33-add8-d55fc15309cc from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:56:57 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:56:57 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 18:56:57 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:56:57 user nova-compute[75051]:   <serial>169dfaf0-ba75-4895-b607-5fc82f571fa2</serial>
Nov 24 18:56:57 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:56:57 user nova-compute[75051]: </disk>
Nov 24 18:56:57 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:56:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:56:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:56:59 user nova-compute[75051]: INFO nova.compute.claims [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Claim successful on node user
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:57:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.policy [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21aa87c3247a4fb8acb794cff1ee372c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701cf22125304244b65b7e59708d8c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:57:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Creating image(s)
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "/opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "/opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.239s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk 1073741824" returned: 0 in 0.051s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Successfully created port: 7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Cannot resize image /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Ensure instance console log exists: /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Successfully updated port: 7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquired lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-changed-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Refreshing instance network info cache due to event network-changed-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] Acquiring lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updating instance_info_cache with network_info: [{"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Releasing lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Instance network_info: |[{"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] Acquired lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Refreshing network info cache for port 7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Start _get_guest_xml network_info=[{"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:57:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-489012342',display_name='tempest-ServersNegativeTestJSON-server-489012342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-489012342',id=16,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-t4fhpzit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:01Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=9ed867b7-145b-4050-8633-2d6a18689a2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ed867b7-145b-4050-8633-2d6a18689a2a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:57:02 user nova-compute[75051]:   <uuid>9ed867b7-145b-4050-8633-2d6a18689a2a</uuid>
Nov 24 18:57:02 user nova-compute[75051]:   <name>instance-00000010</name>
Nov 24 18:57:02 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:57:02 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:57:02 user nova-compute[75051]:   <metadata>
Nov 24 18:57:02 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:57:02 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:name>tempest-ServersNegativeTestJSON-server-489012342</nova:name>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:57:02</nova:creationTime>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:57:02 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:57:02 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:owner>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:user uuid="21aa87c3247a4fb8acb794cff1ee372c">tempest-ServersNegativeTestJSON-1710506599-project-member</nova:user>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:project uuid="701cf22125304244b65b7e59708d8c50">tempest-ServersNegativeTestJSON-1710506599</nova:project>
Nov 24 18:57:02 user nova-compute[75051]:       </nova:owner>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:57:02 user nova-compute[75051]:       <nova:ports>
Nov 24 18:57:02 user nova-compute[75051]:         <nova:port uuid="7fbd8cc4-9932-4bb4-820d-06ed5c779bf4">
Nov 24 18:57:02 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 18:57:02 user nova-compute[75051]:         </nova:port>
Nov 24 18:57:02 user nova-compute[75051]:       </nova:ports>
Nov 24 18:57:02 user nova-compute[75051]:     </nova:instance>
Nov 24 18:57:02 user nova-compute[75051]:   </metadata>
Nov 24 18:57:02 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:57:02 user nova-compute[75051]:     <system>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="serial">9ed867b7-145b-4050-8633-2d6a18689a2a</entry>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="uuid">9ed867b7-145b-4050-8633-2d6a18689a2a</entry>
Nov 24 18:57:02 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:57:02 user nova-compute[75051]:     </system>
Nov 24 18:57:02 user nova-compute[75051]:   </sysinfo>
Nov 24 18:57:02 user nova-compute[75051]:   <os>
Nov 24 18:57:02 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:57:02 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:57:02 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:57:02 user nova-compute[75051]:   </os>
Nov 24 18:57:02 user nova-compute[75051]:   <features>
Nov 24 18:57:02 user nova-compute[75051]:     <acpi/>
Nov 24 18:57:02 user nova-compute[75051]:     <apic/>
Nov 24 18:57:02 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:57:02 user nova-compute[75051]:   </features>
Nov 24 18:57:02 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:57:02 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:57:02 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:57:02 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:57:02 user nova-compute[75051]:   </clock>
Nov 24 18:57:02 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:57:02 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:57:02 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:57:02 user nova-compute[75051]:   </cpu>
Nov 24 18:57:02 user nova-compute[75051]:   <devices>
Nov 24 18:57:02 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:57:02 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:57:02 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk"/>
Nov 24 18:57:02 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:57:02 user nova-compute[75051]:     </disk>
Nov 24 18:57:02 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:57:02 user nova-compute[75051]:       <mac address="fa:16:3e:de:19:e7"/>
Nov 24 18:57:02 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:02 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:57:02 user nova-compute[75051]:       <target dev="tap7fbd8cc4-99"/>
Nov 24 18:57:02 user nova-compute[75051]:     </interface>
Nov 24 18:57:02 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:57:02 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/console.log" append="off"/>
Nov 24 18:57:02 user nova-compute[75051]:     </serial>
Nov 24 18:57:02 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:57:02 user nova-compute[75051]:     <video>
Nov 24 18:57:02 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:02 user nova-compute[75051]:     </video>
Nov 24 18:57:02 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:57:02 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:57:02 user nova-compute[75051]:     </rng>
Nov 24 18:57:02 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:57:02 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:57:02 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:57:02 user nova-compute[75051]:     </memballoon>
Nov 24 18:57:02 user nova-compute[75051]:   </devices>
Nov 24 18:57:02 user nova-compute[75051]: </domain>
Nov 24 18:57:02 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-489012342',display_name='tempest-ServersNegativeTestJSON-server-489012342',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-489012342',id=16,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-t4fhpzit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:01Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=9ed867b7-145b-4050-8633-2d6a18689a2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG os_vif [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05053154-01b0-580a-9de0-7673fb5ec529', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fbd8cc4-99, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fbd8cc4-99, col_values=(('qos', UUID('4ee75969-e20e-41f5-bb84-ce8fef0f25ee')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fbd8cc4-99, col_values=(('external_ids', {'iface-id': '7fbd8cc4-9932-4bb4-820d-06ed5c779bf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:19:e7', 'vm-uuid': '9ed867b7-145b-4050-8633-2d6a18689a2a'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:02 user nova-compute[75051]: INFO os_vif [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99')
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:57:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] No VIF found with MAC fa:16:3e:de:19:e7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:57:03 user nova-compute[75051]: DEBUG nova.network.neutron [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updated VIF entry in instance network info cache for port 7fbd8cc4-9932-4bb4-820d-06ed5c779bf4. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:57:03 user nova-compute[75051]: DEBUG nova.network.neutron [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updating instance_info_cache with network_info: [{"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-40aea407-8719-4764-ba55-55f334c75b44 req-83aa2ae0-663d-42f7-8238-4cfe0d6f74ed service nova] Releasing lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] No waiting events found dispatching network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:04 user nova-compute[75051]: WARNING nova.compute.manager [req-59a35453-4d4b-4f5a-94cb-afb668a07576 req-37550bdb-710b-46f7-9d8f-c6750cfe38e1 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received unexpected event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 for instance with vm_state building and task_state spawning.
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] No waiting events found dispatching network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:06 user nova-compute[75051]: WARNING nova.compute.manager [req-105ba793-cbd5-44dd-a6e9-93b08f3f6b4c req-32edb6fc-dafa-4c3b-a230-4de6b179de53 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received unexpected event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 for instance with vm_state building and task_state spawning.
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:57:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Instance spawned successfully.
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:06 user nova-compute[75051]: INFO nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:57:06 user nova-compute[75051]: INFO nova.compute.manager [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Took 7.16 seconds to build instance.
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba0df3e8-59dc-48dd-aa12-b7b7c3ed4193 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.300s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:57:11 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:11 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7636MB free_disk=25.466026306152344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Applying migration context for instance 451ff98d-318a-4a05-a612-e3ce527d1164 as it has an incoming, in-progress migration 1d9b8905-9432-4935-93e3-a6c38a2e9044. Migration status is finished {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 18:57:11 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating resource usage from migration 1d9b8905-9432-4935-93e3-a6c38a2e9044
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee44d98-b374-4d33-add8-d55fc15309cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Migration 1d9b8905-9432-4935-93e3-a6c38a2e9044 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.630s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:57:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:17 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ee44d98-b374-4d33-add8-d55fc15309cc is timed out.
Nov 24 18:57:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully detached device vdb from instance 1ee44d98-b374-4d33-add8-d55fc15309cc from the live domain config.
Nov 24 18:57:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgbmZsUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:57:17 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9682b51-84ca-4e43-abbd-a78a4db6a59e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:57:17 user nova-compute[75051]: No targets found.
Nov 24 18:57:17 user nova-compute[75051]: iSNS:
Nov 24 18:57:17 user nova-compute[75051]: No targets found.
Nov 24 18:57:17 user nova-compute[75051]: STATIC:
Nov 24 18:57:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2
Nov 24 18:57:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:57:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:57:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:17 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:57:17 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:17 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:17 user nova-compute[75051]: FIRMWARE:
Nov 24 18:57:17 user nova-compute[75051]: No targets found.
Nov 24 18:57:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:57:17 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:57:17 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ad6d6-7606-4e74-b060-6d4699f90ec3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd0e8f-f06d-4503-b37d-3573855b689e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:57:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 (non-flash)
Nov 24 18:57:17 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:57:17 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0435000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3daa3-02fb-4667-93af-1f535d6e656f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0477f0-737f-4dec-ba38-55e6d6d62e3d]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce4f9c-2f60-4f0a-806f-5fdf6ef65190]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:57:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e787f8-d724-44d1-806c-d7e2cac6f64b]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eb491e-6d99-4c23-8eb1-5ee82d1a7855]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe49879-9004-46ec-8671-a1f8659b2a90]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260]
Nov 24 18:57:18 user nova-compute[75051]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2, portal: 172.16.0.220,3260] successful.
Nov 24 18:57:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dde8ea4-cb95-42ea-ac54-2b7fe6d14601]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== disconnect_volume: return (432ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:57:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ce025411-929f-47df-9cdd-e94487f1bf06 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.409s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:19 user nova-compute[75051]: INFO nova.compute.manager [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Terminating instance
Nov 24 18:57:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-unplugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] No waiting events found dispatching network-vif-unplugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-5e67b1ab-4363-4aaf-b21b-1f8bf17abf9c req-fca19e95-65bc-4b24-91f3-91814ce83fb2 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-unplugged-8885bff7-e697-40e4-a3e9-e31a53583e3c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:57:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Instance destroyed successfully.
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'resources' on Instance uuid 1ee44d98-b374-4d33-add8-d55fc15309cc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1563895742',display_name='tempest-VolumesSnapshotTestJSON-instance-1563895742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1563895742',id=12,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGAIGMIctP5fla5OH5VT+3WwCGbt2K0J2sRe2oZgvlStxRtuIOpSTOeo5T9VcCIF37cj+t9b0ZqtcFmOO5VwXz3AvYuE4n+bg8T+JytFamyoN/VK4Fg/LPAjDbflsg1KQ==',key_name='tempest-keypair-1949062510',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:54:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-hi7ago0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=1ee44d98-b374-4d33-add8-d55fc15309cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "address": "fa:16:3e:ea:66:39", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8885bff7-e6", "ovs_interfaceid": "8885bff7-e697-40e4-a3e9-e31a53583e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_vif [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8885bff7-e6, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68944e2f-1f6b-468c-b03a-92d18727c66d) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:20 user nova-compute[75051]: INFO os_vif [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:66:39,bridge_name='br-int',has_traffic_filtering=True,id=8885bff7-e697-40e4-a3e9-e31a53583e3c,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8885bff7-e6')
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QgbmZsUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:57:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[441a0dbf-9317-4bda-a7cd-53f6ba085807]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:57:20 user nova-compute[75051]: No targets found.
Nov 24 18:57:20 user nova-compute[75051]: iSNS:
Nov 24 18:57:20 user nova-compute[75051]: No targets found.
Nov 24 18:57:20 user nova-compute[75051]: STATIC:
Nov 24 18:57:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:57:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:57:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:20 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:57:20 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:57:20 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:57:20 user nova-compute[75051]: FIRMWARE:
Nov 24 18:57:20 user nova-compute[75051]: No targets found.
Nov 24 18:57:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:57:20 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:57:20 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:169dfaf0-ba75-4895-b607-5fc82f571fa2', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e92207-0037-4d7f-9053-d7e71f3bf849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f83bdd-4116-4a1c-b3d5-e0139635dc7d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:57:20 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:57:20 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:57:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:57:20 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:57:20 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:57:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0442a70>, {}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Disconnecting from: [] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== disconnect_volume: return (92ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:57:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Deleting instance files /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc_del
Nov 24 18:57:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Deletion of /opt/stack/data/nova/instances/1ee44d98-b374-4d33-add8-d55fc15309cc_del complete
Nov 24 18:57:20 user nova-compute[75051]: INFO nova.compute.manager [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 24 18:57:20 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:57:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:21 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:21 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Took 1.11 seconds to deallocate network for instance.
Nov 24 18:57:21 user nova-compute[75051]: WARNING nova.volume.cinder [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Attachment 81bdf410-fd35-4952-ada8-f0454b177629 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 81bdf410-fd35-4952-ada8-f0454b177629. (HTTP 404) (Request-ID: req-bc144469-f69b-460b-bb2d-64d5ce88ca49)
Nov 24 18:57:21 user nova-compute[75051]: INFO nova.compute.manager [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Took 0.03 seconds to detach 1 volumes for instance.
Nov 24 18:57:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] Acquiring lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] No waiting events found dispatching network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:22 user nova-compute[75051]: WARNING nova.compute.manager [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received unexpected event network-vif-plugged-8885bff7-e697-40e4-a3e9-e31a53583e3c for instance with vm_state deleted and task_state None.
Nov 24 18:57:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-e89d6868-99ef-4b21-b432-874b278ab131 req-c11b0e5a-6c53-4d00-8293-3e3795fd5cd4 service nova] [instance: 1ee44d98-b374-4d33-add8-d55fc15309cc] Received event network-vif-deleted-8885bff7-e697-40e4-a3e9-e31a53583e3c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:22 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Deleted allocations for instance 1ee44d98-b374-4d33-add8-d55fc15309cc
Nov 24 18:57:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c0bd2629-0947-4cf8-97a7-532cf9829ee7 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "1ee44d98-b374-4d33-add8-d55fc15309cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:57:32 user nova-compute[75051]: INFO nova.compute.claims [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Claim successful on node user
Nov 24 18:57:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:57:32 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.policy [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2951a4e0d2a4655aff205ffbf47f0ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1f2356690c4e7eb341c4f0918c249e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:57:32 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Creating image(s)
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "/opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "/opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "/opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.212s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk 1073741824" returned: 0 in 0.061s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.213s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Cannot resize image /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Ensure instance console log exists: /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Successfully created port: 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Successfully updated port: 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquired lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-changed-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Refreshing instance network info cache due to event network-changed-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] Acquiring lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating instance_info_cache with network_info: [{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Releasing lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Instance network_info: |[{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] Acquired lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Refreshing network info cache for port 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Start _get_guest_xml network_info=[{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:57:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467361559',display_name='tempest-SnapshotDataIntegrityTests-server-467361559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467361559',id=17,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgEmrDJ+kvqkwhAFueAP8QmaUarIAHW4o/fnbCOvUi1ww3K9im44b37Q2V2qvcUSiXOJgUk6Yy2gLx9OHZ5OpLXCpMS7sUYF5iSMiAs8O0XFPL2K+NN2Ta7uc6rlYoqvg==',key_name='tempest-keypair-675822322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c1f2356690c4e7eb341c4f0918c249e',ramdisk_id='',reservation_id='r-zujsj3vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1366443690',owner_user_name='tempest-SnapshotDataIntegrityTests-1366443690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2951a4e0d2a4655aff205ffbf47f0ba',uuid=92037f21-165b-4e14-96c9-7656e6c4a2c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converting VIF {"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'pci_devices' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:57:36 user nova-compute[75051]:   <uuid>92037f21-165b-4e14-96c9-7656e6c4a2c4</uuid>
Nov 24 18:57:36 user nova-compute[75051]:   <name>instance-00000011</name>
Nov 24 18:57:36 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:57:36 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:57:36 user nova-compute[75051]:   <metadata>
Nov 24 18:57:36 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:57:36 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-467361559</nova:name>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:57:36</nova:creationTime>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:57:36 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:57:36 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:owner>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:user uuid="a2951a4e0d2a4655aff205ffbf47f0ba">tempest-SnapshotDataIntegrityTests-1366443690-project-member</nova:user>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:project uuid="5c1f2356690c4e7eb341c4f0918c249e">tempest-SnapshotDataIntegrityTests-1366443690</nova:project>
Nov 24 18:57:36 user nova-compute[75051]:       </nova:owner>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:57:36 user nova-compute[75051]:       <nova:ports>
Nov 24 18:57:36 user nova-compute[75051]:         <nova:port uuid="69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1">
Nov 24 18:57:36 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 18:57:36 user nova-compute[75051]:         </nova:port>
Nov 24 18:57:36 user nova-compute[75051]:       </nova:ports>
Nov 24 18:57:36 user nova-compute[75051]:     </nova:instance>
Nov 24 18:57:36 user nova-compute[75051]:   </metadata>
Nov 24 18:57:36 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:57:36 user nova-compute[75051]:     <system>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="serial">92037f21-165b-4e14-96c9-7656e6c4a2c4</entry>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="uuid">92037f21-165b-4e14-96c9-7656e6c4a2c4</entry>
Nov 24 18:57:36 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:57:36 user nova-compute[75051]:     </system>
Nov 24 18:57:36 user nova-compute[75051]:   </sysinfo>
Nov 24 18:57:36 user nova-compute[75051]:   <os>
Nov 24 18:57:36 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:57:36 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:57:36 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:57:36 user nova-compute[75051]:   </os>
Nov 24 18:57:36 user nova-compute[75051]:   <features>
Nov 24 18:57:36 user nova-compute[75051]:     <acpi/>
Nov 24 18:57:36 user nova-compute[75051]:     <apic/>
Nov 24 18:57:36 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:57:36 user nova-compute[75051]:   </features>
Nov 24 18:57:36 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:57:36 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:57:36 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:57:36 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:57:36 user nova-compute[75051]:   </clock>
Nov 24 18:57:36 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:57:36 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:57:36 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:57:36 user nova-compute[75051]:   </cpu>
Nov 24 18:57:36 user nova-compute[75051]:   <devices>
Nov 24 18:57:36 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:57:36 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:57:36 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk"/>
Nov 24 18:57:36 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:57:36 user nova-compute[75051]:     </disk>
Nov 24 18:57:36 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:57:36 user nova-compute[75051]:       <mac address="fa:16:3e:93:f0:e2"/>
Nov 24 18:57:36 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:36 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:57:36 user nova-compute[75051]:       <target dev="tap69ea9cb6-c0"/>
Nov 24 18:57:36 user nova-compute[75051]:     </interface>
Nov 24 18:57:36 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:57:36 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/console.log" append="off"/>
Nov 24 18:57:36 user nova-compute[75051]:     </serial>
Nov 24 18:57:36 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:57:36 user nova-compute[75051]:     <video>
Nov 24 18:57:36 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:36 user nova-compute[75051]:     </video>
Nov 24 18:57:36 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:57:36 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:57:36 user nova-compute[75051]:     </rng>
Nov 24 18:57:36 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:57:36 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:57:36 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:57:36 user nova-compute[75051]:     </memballoon>
Nov 24 18:57:36 user nova-compute[75051]:   </devices>
Nov 24 18:57:36 user nova-compute[75051]: </domain>
Nov 24 18:57:36 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467361559',display_name='tempest-SnapshotDataIntegrityTests-server-467361559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467361559',id=17,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgEmrDJ+kvqkwhAFueAP8QmaUarIAHW4o/fnbCOvUi1ww3K9im44b37Q2V2qvcUSiXOJgUk6Yy2gLx9OHZ5OpLXCpMS7sUYF5iSMiAs8O0XFPL2K+NN2Ta7uc6rlYoqvg==',key_name='tempest-keypair-675822322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c1f2356690c4e7eb341c4f0918c249e',ramdisk_id='',reservation_id='r-zujsj3vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1366443690',owner_user_name='tempest-SnapshotDataIntegrityTests-1366443690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2951a4e0d2a4655aff205ffbf47f0ba',uuid=92037f21-165b-4e14-96c9-7656e6c4a2c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converting VIF {"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG os_vif [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3acac102-399b-51b2-ab45-3d93d414465a', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69ea9cb6-c0, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69ea9cb6-c0, col_values=(('qos', UUID('f2d62f87-9872-4b6f-80d3-1625e5ffbce7')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69ea9cb6-c0, col_values=(('external_ids', {'iface-id': '69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:f0:e2', 'vm-uuid': '92037f21-165b-4e14-96c9-7656e6c4a2c4'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:36 user nova-compute[75051]: INFO os_vif [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0')
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No VIF found with MAC fa:16:3e:93:f0:e2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updated VIF entry in instance network info cache for port 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating instance_info_cache with network_info: [{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a07eb06d-747f-4429-86bb-fbea2034ea53 req-929ecc71-65b2-45bc-86e8-317d74306f5a service nova] Releasing lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:57:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Instance spawned successfully.
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:40 user nova-compute[75051]: INFO nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 24 18:57:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:57:40 user nova-compute[75051]: INFO nova.compute.manager [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Took 8.26 seconds to build instance.
Nov 24 18:57:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0eb25bbc-47e5-4681-81e1-2a2429c02ee5 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.364s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] No waiting events found dispatching network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:41 user nova-compute[75051]: WARNING nova.compute.manager [req-5a83dbd7-5174-4d6b-a175-289b0ff58d65 req-be87d38a-2689-497c-b258-da9f54364cd0 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received unexpected event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 for instance with vm_state active and task_state None.
Nov 24 18:57:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] No waiting events found dispatching network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:43 user nova-compute[75051]: WARNING nova.compute.manager [req-af6987a5-8d44-45ab-a40c-d9121f953582 req-1706036c-857b-45ee-ab66-58ec9d082e4d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received unexpected event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 for instance with vm_state active and task_state None.
Nov 24 18:57:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:57:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:57:45 user nova-compute[75051]: INFO nova.compute.claims [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Claim successful on node user
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:57:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.policy [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38ec62f093e46bc92c48a2194e69ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d8b0e6ade24b3bb09c0860de12e31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:57:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Creating image(s)
Nov 24 18:57:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "/opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "/opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "/opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk 1073741824" returned: 0 in 0.049s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Successfully created port: 7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Cannot resize image /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Ensure instance console log exists: /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Successfully updated port: 7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquired lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-changed-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Refreshing instance network info cache due to event network-changed-7d0f55b7-14e8-46af-b3d8-214a3ec965bb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] Acquiring lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:57:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updating instance_info_cache with network_info: [{"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Releasing lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Instance network_info: |[{"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] Acquired lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Refreshing network info cache for port 7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Start _get_guest_xml network_info=[{"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:57:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-72581091',display_name='tempest-VolumesAdminNegativeTest-server-72581091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-72581091',id=18,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDme2wdpURNShBEyhGBmCvRN8QTHd0uG4zisZl49rqkKAO8L2GKDSkqp9sZC1jTuDrQftzBi2F96lT6Dm2CXS9gqG/mhS6z/frgE5KQWsuEDei569ylpSRjI1lftMgWsag==',key_name='tempest-keypair-500087197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-nmgkafuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=59738ebd-376f-4f6b-b9e5-3177010fc54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'pci_devices' on Instance uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:57:50 user nova-compute[75051]:   <uuid>59738ebd-376f-4f6b-b9e5-3177010fc54e</uuid>
Nov 24 18:57:50 user nova-compute[75051]:   <name>instance-00000012</name>
Nov 24 18:57:50 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:57:50 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:57:50 user nova-compute[75051]:   <metadata>
Nov 24 18:57:50 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:57:50 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:name>tempest-VolumesAdminNegativeTest-server-72581091</nova:name>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:57:50</nova:creationTime>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:57:50 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:57:50 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:owner>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:user uuid="d38ec62f093e46bc92c48a2194e69ab6">tempest-VolumesAdminNegativeTest-659921402-project-member</nova:user>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:project uuid="b1d8b0e6ade24b3bb09c0860de12e31c">tempest-VolumesAdminNegativeTest-659921402</nova:project>
Nov 24 18:57:50 user nova-compute[75051]:       </nova:owner>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:57:50 user nova-compute[75051]:       <nova:ports>
Nov 24 18:57:50 user nova-compute[75051]:         <nova:port uuid="7d0f55b7-14e8-46af-b3d8-214a3ec965bb">
Nov 24 18:57:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 18:57:50 user nova-compute[75051]:         </nova:port>
Nov 24 18:57:50 user nova-compute[75051]:       </nova:ports>
Nov 24 18:57:50 user nova-compute[75051]:     </nova:instance>
Nov 24 18:57:50 user nova-compute[75051]:   </metadata>
Nov 24 18:57:50 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:57:50 user nova-compute[75051]:     <system>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="serial">59738ebd-376f-4f6b-b9e5-3177010fc54e</entry>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="uuid">59738ebd-376f-4f6b-b9e5-3177010fc54e</entry>
Nov 24 18:57:50 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:57:50 user nova-compute[75051]:     </system>
Nov 24 18:57:50 user nova-compute[75051]:   </sysinfo>
Nov 24 18:57:50 user nova-compute[75051]:   <os>
Nov 24 18:57:50 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:57:50 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:57:50 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:57:50 user nova-compute[75051]:   </os>
Nov 24 18:57:50 user nova-compute[75051]:   <features>
Nov 24 18:57:50 user nova-compute[75051]:     <acpi/>
Nov 24 18:57:50 user nova-compute[75051]:     <apic/>
Nov 24 18:57:50 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:57:50 user nova-compute[75051]:   </features>
Nov 24 18:57:50 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:57:50 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:57:50 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:57:50 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:57:50 user nova-compute[75051]:   </clock>
Nov 24 18:57:50 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:57:50 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:57:50 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:57:50 user nova-compute[75051]:   </cpu>
Nov 24 18:57:50 user nova-compute[75051]:   <devices>
Nov 24 18:57:50 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:57:50 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:57:50 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk"/>
Nov 24 18:57:50 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:57:50 user nova-compute[75051]:     </disk>
Nov 24 18:57:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:57:50 user nova-compute[75051]:       <mac address="fa:16:3e:32:3a:cc"/>
Nov 24 18:57:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:57:50 user nova-compute[75051]:       <target dev="tap7d0f55b7-14"/>
Nov 24 18:57:50 user nova-compute[75051]:     </interface>
Nov 24 18:57:50 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:57:50 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/console.log" append="off"/>
Nov 24 18:57:50 user nova-compute[75051]:     </serial>
Nov 24 18:57:50 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:57:50 user nova-compute[75051]:     <video>
Nov 24 18:57:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:50 user nova-compute[75051]:     </video>
Nov 24 18:57:50 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:57:50 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:57:50 user nova-compute[75051]:     </rng>
Nov 24 18:57:50 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:57:50 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:57:50 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:57:50 user nova-compute[75051]:     </memballoon>
Nov 24 18:57:50 user nova-compute[75051]:   </devices>
Nov 24 18:57:50 user nova-compute[75051]: </domain>
Nov 24 18:57:50 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-72581091',display_name='tempest-VolumesAdminNegativeTest-server-72581091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-72581091',id=18,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDme2wdpURNShBEyhGBmCvRN8QTHd0uG4zisZl49rqkKAO8L2GKDSkqp9sZC1jTuDrQftzBi2F96lT6Dm2CXS9gqG/mhS6z/frgE5KQWsuEDei569ylpSRjI1lftMgWsag==',key_name='tempest-keypair-500087197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-nmgkafuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=59738ebd-376f-4f6b-b9e5-3177010fc54e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG os_vif [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3541d036-abeb-580e-8371-e9aa584427a4', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d0f55b7-14, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d0f55b7-14, col_values=(('qos', UUID('662c4469-755f-44ae-9fc3-6aeb8e535dce')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d0f55b7-14, col_values=(('external_ids', {'iface-id': '7d0f55b7-14e8-46af-b3d8-214a3ec965bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:3a:cc', 'vm-uuid': '59738ebd-376f-4f6b-b9e5-3177010fc54e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:50 user nova-compute[75051]: INFO os_vif [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14')
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:57:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No VIF found with MAC fa:16:3e:32:3a:cc, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:57:51 user nova-compute[75051]: INFO nova.compute.claims [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Claim successful on node user
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updated VIF entry in instance network info cache for port 7d0f55b7-14e8-46af-b3d8-214a3ec965bb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updating instance_info_cache with network_info: [{"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-664d89e8-e59f-4386-ac41-1d694db22fc1 req-37853554-8d46-4861-903e-61695c774642 service nova] Releasing lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.policy [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d258dfa49264233b121b20e2a59ee09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f5348de50a4a45a1ead31a1865a687', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:57:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Creating image(s)
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "/opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "/opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "/opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk 1073741824" returned: 0 in 0.095s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Successfully created port: a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Cannot resize image /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Ensure instance console log exists: /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Successfully updated port: a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquired lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-changed-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Refreshing instance network info cache due to event network-changed-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] Acquiring lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:57:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Instance spawned successfully.
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Updating instance_info_cache with network_info: [{"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Releasing lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Instance network_info: |[{"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] Acquired lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Refreshing network info cache for port a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Start _get_guest_xml network_info=[{"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:57:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:57:54 user nova-compute[75051]: INFO nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Took 7.96 seconds to spawn the instance on the hypervisor.
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-720651679',display_name='tempest-VolumesActionsTest-instance-720651679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-720651679',id=19,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19f5348de50a4a45a1ead31a1865a687',ramdisk_id='',reservation_id='r-6e214ujk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-608271058',owner_user_name='tempest-VolumesActionsTest-608271058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:52Z,user_data=None,user_id='1d258dfa49264233b121b20e2a59ee09',uuid=f03918f8-eaa5-4947-96b4-a5b01cb58982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converting VIF {"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lazy-loading 'pci_devices' on Instance uuid f03918f8-eaa5-4947-96b4-a5b01cb58982 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:57:54 user nova-compute[75051]:   <uuid>f03918f8-eaa5-4947-96b4-a5b01cb58982</uuid>
Nov 24 18:57:54 user nova-compute[75051]:   <name>instance-00000013</name>
Nov 24 18:57:54 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:57:54 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:57:54 user nova-compute[75051]:   <metadata>
Nov 24 18:57:54 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:57:54 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:name>tempest-VolumesActionsTest-instance-720651679</nova:name>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:57:54</nova:creationTime>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:57:54 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:57:54 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:owner>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:user uuid="1d258dfa49264233b121b20e2a59ee09">tempest-VolumesActionsTest-608271058-project-member</nova:user>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:project uuid="19f5348de50a4a45a1ead31a1865a687">tempest-VolumesActionsTest-608271058</nova:project>
Nov 24 18:57:54 user nova-compute[75051]:       </nova:owner>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:57:54 user nova-compute[75051]:       <nova:ports>
Nov 24 18:57:54 user nova-compute[75051]:         <nova:port uuid="a72270d5-0fe6-412c-aa0c-0aa2df8e12d8">
Nov 24 18:57:54 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 18:57:54 user nova-compute[75051]:         </nova:port>
Nov 24 18:57:54 user nova-compute[75051]:       </nova:ports>
Nov 24 18:57:54 user nova-compute[75051]:     </nova:instance>
Nov 24 18:57:54 user nova-compute[75051]:   </metadata>
Nov 24 18:57:54 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:57:54 user nova-compute[75051]:     <system>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="serial">f03918f8-eaa5-4947-96b4-a5b01cb58982</entry>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="uuid">f03918f8-eaa5-4947-96b4-a5b01cb58982</entry>
Nov 24 18:57:54 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:57:54 user nova-compute[75051]:     </system>
Nov 24 18:57:54 user nova-compute[75051]:   </sysinfo>
Nov 24 18:57:54 user nova-compute[75051]:   <os>
Nov 24 18:57:54 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:57:54 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:57:54 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:57:54 user nova-compute[75051]:   </os>
Nov 24 18:57:54 user nova-compute[75051]:   <features>
Nov 24 18:57:54 user nova-compute[75051]:     <acpi/>
Nov 24 18:57:54 user nova-compute[75051]:     <apic/>
Nov 24 18:57:54 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:57:54 user nova-compute[75051]:   </features>
Nov 24 18:57:54 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:57:54 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:57:54 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:57:54 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:57:54 user nova-compute[75051]:   </clock>
Nov 24 18:57:54 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:57:54 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:57:54 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:57:54 user nova-compute[75051]:   </cpu>
Nov 24 18:57:54 user nova-compute[75051]:   <devices>
Nov 24 18:57:54 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:57:54 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:57:54 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk"/>
Nov 24 18:57:54 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:57:54 user nova-compute[75051]:     </disk>
Nov 24 18:57:54 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:57:54 user nova-compute[75051]:       <mac address="fa:16:3e:97:5c:60"/>
Nov 24 18:57:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:54 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:57:54 user nova-compute[75051]:       <target dev="tapa72270d5-0f"/>
Nov 24 18:57:54 user nova-compute[75051]:     </interface>
Nov 24 18:57:54 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:57:54 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/console.log" append="off"/>
Nov 24 18:57:54 user nova-compute[75051]:     </serial>
Nov 24 18:57:54 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:57:54 user nova-compute[75051]:     <video>
Nov 24 18:57:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:57:54 user nova-compute[75051]:     </video>
Nov 24 18:57:54 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:57:54 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:57:54 user nova-compute[75051]:     </rng>
Nov 24 18:57:54 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:57:54 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:57:54 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:57:54 user nova-compute[75051]:     </memballoon>
Nov 24 18:57:54 user nova-compute[75051]:   </devices>
Nov 24 18:57:54 user nova-compute[75051]: </domain>
Nov 24 18:57:54 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-720651679',display_name='tempest-VolumesActionsTest-instance-720651679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-720651679',id=19,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19f5348de50a4a45a1ead31a1865a687',ramdisk_id='',reservation_id='r-6e214ujk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-608271058',owner_user_name='tempest-VolumesActionsTest-608271058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:57:52Z,user_data=None,user_id='1d258dfa49264233b121b20e2a59ee09',uuid=f03918f8-eaa5-4947-96b4-a5b01cb58982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converting VIF {"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG os_vif [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f885ad1-dafa-5aed-9f8c-9e126a5993c2', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:54 user nova-compute[75051]: INFO nova.compute.manager [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Took 9.32 seconds to build instance.
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa72270d5-0f, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa72270d5-0f, col_values=(('qos', UUID('9cf24ccd-5bb3-4897-9785-375156e7034d')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa72270d5-0f, col_values=(('external_ids', {'iface-id': 'a72270d5-0fe6-412c-aa0c-0aa2df8e12d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:5c:60', 'vm-uuid': 'f03918f8-eaa5-4947-96b4-a5b01cb58982'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b6441886-1902-4f94-bca1-8dcbab85155f tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.424s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:54 user nova-compute[75051]: INFO os_vif [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f')
Nov 24 18:57:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] No VIF found with MAC fa:16:3e:97:5c:60, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Updated VIF entry in instance network info cache for port a72270d5-0fe6-412c-aa0c-0aa2df8e12d8. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Updating instance_info_cache with network_info: [{"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-46e9ab20-1e52-4ef6-9209-c15f8a7a646b req-2d0a01e1-41d2-4c71-8003-53b068c37d60 service nova] Releasing lock "refresh_cache-f03918f8-eaa5-4947-96b4-a5b01cb58982" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:55 user nova-compute[75051]: INFO nova.compute.manager [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Terminating instance
Nov 24 18:57:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] No waiting events found dispatching network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:56 user nova-compute[75051]: WARNING nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received unexpected event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb for instance with vm_state active and task_state None.
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] No waiting events found dispatching network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:56 user nova-compute[75051]: WARNING nova.compute.manager [req-9be2834f-f43b-423d-990b-2cb57dbe3503 req-71aeca44-fc0d-4b49-91cf-17713c62b178 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received unexpected event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb for instance with vm_state active and task_state None.
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-unplugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] No waiting events found dispatching network-vif-unplugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-3fd21a09-1b72-49ad-a2a4-1b2cc4b1c63d req-d03bdded-219b-4c7d-a90f-312dbe2ef5fa service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-unplugged-be5315fe-1fc2-4a50-bfd7-61b664930081 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] No waiting events found dispatching network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:56 user nova-compute[75051]: WARNING nova.compute.manager [req-5e0ca079-b266-4565-8708-c831646667a4 req-f0ef46d4-377a-4ece-8ae4-79a5638f34ae service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received unexpected event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 for instance with vm_state building and task_state spawning.
Nov 24 18:57:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Instance destroyed successfully.
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lazy-loading 'resources' on Instance uuid f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2111282644',display_name='tempest-VolumesNegativeTest-instance-2111282644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2111282644',id=13,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f33c0ab52ea46f88d188aba75f5dea0',ramdisk_id='',reservation_id='r-xqg6y2vp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-213499810',owner_user_name='tempest-VolumesNegativeTest-213499810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:56:14Z,user_data=None,user_id='e67434b135854fcfbf6d89ab0585ff39',uuid=f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converting VIF {"id": "be5315fe-1fc2-4a50-bfd7-61b664930081", "address": "fa:16:3e:d4:36:aa", "network": {"id": "924eb57b-c12d-44f9-8372-51ef50928e11", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be2d2ee0c4dc49409908852df329de5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe5315fe-1f", "ovs_interfaceid": "be5315fe-1fc2-4a50-bfd7-61b664930081", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG os_vif [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe5315fe-1f, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=409e1ae6-4fc4-42fd-8911-72397c2f323c) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:57:57 user nova-compute[75051]: INFO os_vif [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:36:aa,bridge_name='br-int',has_traffic_filtering=True,id=be5315fe-1fc2-4a50-bfd7-61b664930081,network=Network(924eb57b-c12d-44f9-8372-51ef50928e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe5315fe-1f')
Nov 24 18:57:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Deleting instance files /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e_del
Nov 24 18:57:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Deletion of /opt/stack/data/nova/instances/f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e_del complete
Nov 24 18:57:57 user nova-compute[75051]: INFO nova.compute.manager [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 24 18:57:57 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:57:58 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Took 0.67 seconds to deallocate network for instance.
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-d4062afc-b7be-4669-ad0e-426c7711269e req-4395306d-15b8-4942-bf8e-271d29ed1a41 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-deleted-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] Acquiring lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] No waiting events found dispatching network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:58 user nova-compute[75051]: WARNING nova.compute.manager [req-a272e511-8593-4434-8336-0e861d127a4e req-6496a5e8-b588-41e0-9f14-39e86dfc4ed0 service nova] [instance: f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e] Received unexpected event network-vif-plugged-be5315fe-1fc2-4a50-bfd7-61b664930081 for instance with vm_state deleted and task_state None.
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:58 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Deleted allocations for instance f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c227682c-d6f3-4b7f-83c0-924d2b88151e tempest-VolumesNegativeTest-213499810 tempest-VolumesNegativeTest-213499810-project-member] Lock "f1fe21bc-c4f8-4c76-96f5-345ae0b23c9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] No waiting events found dispatching network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:57:58 user nova-compute[75051]: WARNING nova.compute.manager [req-a4740fd9-5ac8-4a06-8e31-bc848d89ded6 req-4302d888-29d1-4d45-8b5f-d79dbf53748e service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received unexpected event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 for instance with vm_state building and task_state spawning.
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:57:59 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Instance spawned successfully.
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:57:59 user nova-compute[75051]: INFO nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Took 7.08 seconds to spawn the instance on the hypervisor.
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:57:59 user nova-compute[75051]: INFO nova.compute.manager [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Took 8.21 seconds to build instance.
Nov 24 18:57:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa34f261-b2f2-4b04-b04a-08160fdff04c tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.334s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:57:59 user nova-compute[75051]: INFO nova.compute.manager [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Rescuing
Nov 24 18:57:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:57:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:00 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance destroyed successfully.
Nov 24 18:58:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Attempting a stable device rescue
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:01 user nova-compute[75051]: WARNING nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state active and task_state rescuing.
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:01 user nova-compute[75051]: WARNING nova.compute.manager [req-86801ba2-9f2c-4981-bd51-94c24c03e567 req-9ad3f305-dc81-4347-a567-8b19cdf1b639 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state active and task_state rescuing.
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 18:58:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Creating image(s)
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'trusted_certs' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG nova.virt.images [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] 3ba8eedf-a3d1-49dc-a15d-02ed4d5c9c91 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.part /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.part /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.converted" returned: 0 in 0.470s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.091s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427 --force-share --output=json" returned: 0 in 0.255s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427,backing_fmt=raw /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427,backing_fmt=raw /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue" returned: 0 in 0.085s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "195c0fe9df4d997d3d36d61f66e088636ddf9427" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'migration_context' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<71e108a3-b5c9-4ffa-ad9c-21597ebc43df> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start _get_guest_xml network_info=[{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:74:ea:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3ba8eedf-a3d1-49dc-a15d-02ed4d5c9c91', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '71e108a3-b5c9-4ffa-ad9c-21597ebc43df', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'serial': 'fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'b9c91f44-c6ce-4a29-a51c-dc096fe4db9e', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<71e108a3-b5c9-4ffa-ad9c-21597ebc43df> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'numa_topology' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<71e108a3-b5c9-4ffa-ad9c-21597ebc43df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:03 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:03 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'vcpu_model' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.objects.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<71e108a3-b5c9-4ffa-ad9c-21597ebc43df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:58:03 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:58:03 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:58:03 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7895b3-b6a7-42f2-bd36-a00971f75292]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MTuyGqie\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 18:58:03 user nova-compute[75051]: node.name = iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:58:03 user nova-compute[75051]: node.tpgt = -1
Nov 24 18:58:03 user nova-compute[75051]: node.startup = automatic
Nov 24 18:58:03 user nova-compute[75051]: node.leading_login = No
Nov 24 18:58:03 user nova-compute[75051]: iface.iscsi_ifacename = default
Nov 24 18:58:03 user nova-compute[75051]: iface.net_ifacename = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.ipaddress = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.prefix_len = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.hwaddress = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.transport_name = tcp
Nov 24 18:58:03 user nova-compute[75051]: iface.initiatorname = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.vlan_id = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.vlan_priority = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.vlan_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.iface_num = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.mtu = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.port = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.bootproto = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.subnet_mask = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.gateway = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_alt_client_id = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_dns = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_learn_iqn = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_vendor_id_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_vendor_id = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.dhcp_slp_da = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.fragmentation = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.gratuitous_arp = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.incoming_forwarding = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.tos_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.tos = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.ttl = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.delayed_ack = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.tcp_nagle = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.tcp_wsf_state = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.tcp_wsf = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.tcp_timer_scale = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.tcp_timestamp = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.redirect = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.def_task_mgmt_timeout = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.header_digest = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.data_digest = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.immediate_data = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.initial_r2t = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.data_seq_inorder = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.data_pdu_inorder = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.erl = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.max_receive_data_len = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.first_burst_len = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.max_outstanding_r2t = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.max_burst_len = 0
Nov 24 18:58:03 user nova-compute[75051]: iface.chap_auth = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.bidi_chap = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.strict_login_compliance = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.discovery_auth = <empty>
Nov 24 18:58:03 user nova-compute[75051]: iface.discovery_logout = <empty>
Nov 24 18:58:03 user nova-compute[75051]: node.discovery_address = <empty>
Nov 24 18:58:03 user nova-compute[75051]: node.discovery_port = 0
Nov 24 18:58:03 user nova-compute[75051]: node.discovery_type = static
Nov 24 18:58:03 user nova-compute[75051]: node.session.initial_cmdsn = 0
Nov 24 18:58:03 user nova-compute[75051]: node.session.initial_login_retry_max = 8
Nov 24 18:58:03 user nova-compute[75051]: node.session.xmit_thread_priority = -20
Nov 24 18:58:03 user nova-compute[75051]: node.session.cmds_max = 128
Nov 24 18:58:03 user nova-compute[75051]: node.session.queue_depth = 32
Nov 24 18:58:03 user nova-compute[75051]: node.session.nr_sessions = 1
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.authmethod = CHAP
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.username = MTuyGqie
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.password = ***
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.username_in = <empty>
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.password_in = <empty>
Nov 24 18:58:03 user nova-compute[75051]: node.session.auth.chap_algs = MD5
Nov 24 18:58:03 user nova-compute[75051]: node.session.timeo.replacement_timeout = 120
Nov 24 18:58:03 user nova-compute[75051]: node.session.err_timeo.abort_timeout = 15
Nov 24 18:58:03 user nova-compute[75051]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 18:58:03 user nova-compute[75051]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 18:58:03 user nova-compute[75051]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.FastAbort = Yes
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.InitialR2T = No
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.ImmediateData = Yes
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.MaxConnections = 1
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 18:58:03 user nova-compute[75051]: node.session.iscsi.ERL = 0
Nov 24 18:58:03 user nova-compute[75051]: node.session.scan = manual
Nov 24 18:58:03 user nova-compute[75051]: node.session.reopen_max = 0
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].address = 172.16.0.220
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].port = 3260
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].startup = manual
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].tcp.window_size = 524288
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].tcp.type_of_service = 0
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].timeo.logout_timeout = 15
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].timeo.login_timeout = 15
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].timeo.auth_timeout = 45
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.DataDigest = None
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.IFMarker = No
Nov 24 18:58:03 user nova-compute[75051]: node.conn[0].iscsi.OFMarker = No
Nov 24 18:58:03 user nova-compute[75051]: # END RECORD
Nov 24 18:58:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94be5ff-56f2-419a-8297-ae489057cf8b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526dfe6-1539-44d2-a534-a9918d40556f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTuyGqie {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MTuyGqie" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f6278c-a17b-4edd-929c-151b4c8a470a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MTuyGqie'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[435016d6-c671-4047-9965-5bd418e048eb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c2bc53-9810-4ada-a3d9-57d6f3865df5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:03 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:03 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:03 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:03 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] HCTL ('33', '0', '0', 0) found on session 20 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3557e4e8-ff78-48b9-af37-5fc4fa65a022]: (4, ('0 0 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching for a device in session 20 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== connect_volume: return (227ms) {'type': 'block', 'scsi_wwn': '23732383365306664', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732383365306664', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928277371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928277371',id=14,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-9s0s0dbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:56:31Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=71e108a3-b5c9-4ffa-ad9c-21597ebc43df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:74:ea:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:58:03 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:74:ea:25"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.objects.base [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<71e108a3-b5c9-4ffa-ad9c-21597ebc43df> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:58:04 user nova-compute[75051]:   <uuid>71e108a3-b5c9-4ffa-ad9c-21597ebc43df</uuid>
Nov 24 18:58:04 user nova-compute[75051]:   <name>instance-0000000e</name>
Nov 24 18:58:04 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:58:04 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:58:04 user nova-compute[75051]:   <metadata>
Nov 24 18:58:04 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:58:04 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-928277371</nova:name>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:58:03</nova:creationTime>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:58:04 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:58:04 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:owner>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 18:58:04 user nova-compute[75051]:       </nova:owner>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:58:04 user nova-compute[75051]:       <nova:ports>
Nov 24 18:58:04 user nova-compute[75051]:         <nova:port uuid="b98940b3-11d3-4f74-b474-3ad878481c60">
Nov 24 18:58:04 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 18:58:04 user nova-compute[75051]:         </nova:port>
Nov 24 18:58:04 user nova-compute[75051]:       </nova:ports>
Nov 24 18:58:04 user nova-compute[75051]:     </nova:instance>
Nov 24 18:58:04 user nova-compute[75051]:   </metadata>
Nov 24 18:58:04 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:58:04 user nova-compute[75051]:     <system>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="serial">71e108a3-b5c9-4ffa-ad9c-21597ebc43df</entry>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="uuid">71e108a3-b5c9-4ffa-ad9c-21597ebc43df</entry>
Nov 24 18:58:04 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:58:04 user nova-compute[75051]:     </system>
Nov 24 18:58:04 user nova-compute[75051]:   </sysinfo>
Nov 24 18:58:04 user nova-compute[75051]:   <os>
Nov 24 18:58:04 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:58:04 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:58:04 user nova-compute[75051]:   </os>
Nov 24 18:58:04 user nova-compute[75051]:   <features>
Nov 24 18:58:04 user nova-compute[75051]:     <acpi/>
Nov 24 18:58:04 user nova-compute[75051]:     <apic/>
Nov 24 18:58:04 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:58:04 user nova-compute[75051]:   </features>
Nov 24 18:58:04 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:58:04 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:58:04 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:58:04 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:58:04 user nova-compute[75051]:   </clock>
Nov 24 18:58:04 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:58:04 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:58:04 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:58:04 user nova-compute[75051]:   </cpu>
Nov 24 18:58:04 user nova-compute[75051]:   <devices>
Nov 24 18:58:04 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:58:04 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:58:04 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 18:58:04 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:58:04 user nova-compute[75051]:       <serial>fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4</serial>
Nov 24 18:58:04 user nova-compute[75051]:     </disk>
Nov 24 18:58:04 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:58:04 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:58:04 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue"/>
Nov 24 18:58:04 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:58:04 user nova-compute[75051]:       <boot order="1"/>
Nov 24 18:58:04 user nova-compute[75051]:     </disk>
Nov 24 18:58:04 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:58:04 user nova-compute[75051]:       <mac address="fa:16:3e:74:ea:25"/>
Nov 24 18:58:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:04 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:58:04 user nova-compute[75051]:       <target dev="tapb98940b3-11"/>
Nov 24 18:58:04 user nova-compute[75051]:     </interface>
Nov 24 18:58:04 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:58:04 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/console.log" append="off"/>
Nov 24 18:58:04 user nova-compute[75051]:     </serial>
Nov 24 18:58:04 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:58:04 user nova-compute[75051]:     <video>
Nov 24 18:58:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:04 user nova-compute[75051]:     </video>
Nov 24 18:58:04 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:58:04 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:58:04 user nova-compute[75051]:     </rng>
Nov 24 18:58:04 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:58:04 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:58:04 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:58:04 user nova-compute[75051]:     </memballoon>
Nov 24 18:58:04 user nova-compute[75051]:   </devices>
Nov 24 18:58:04 user nova-compute[75051]: </domain>
Nov 24 18:58:04 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:58:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance destroyed successfully.
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:58:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:74:ea:25, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:58:05 user nova-compute[75051]: INFO nova.compute.claims [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Claim successful on node user
Nov 24 18:58:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:05 user nova-compute[75051]: WARNING nova.compute.manager [req-13da5dc3-ccc9-45f8-84e3-241f4e4e7fb1 req-c4ee8a55-bb9e-4b14-9544-afd70753de02 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state active and task_state rescuing.
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:58:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.policy [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c14d0f83b34441f998e48bf56844dec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2ae522b213c4592acb5df152b4266a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:58:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Creating image(s)
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "/opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "/opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "/opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.536s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.228s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk 1073741824" returned: 0 in 0.066s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Successfully created port: 8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:07 user nova-compute[75051]: WARNING nova.compute.manager [req-c3d7e9a0-9334-4e02-9595-55bbfd47a624 req-4bba5c0c-e175-4aa9-8ead-2758dce7dc3d service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state active and task_state rescuing.
Nov 24 18:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Skipping network cache update for instance because it is Building. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Cannot resize image /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Ensure instance console log exists: /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Successfully updated port: 8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquired lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-changed-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.compute.manager [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Refreshing instance network info cache due to event network-changed-8a7c97d1-68a3-4b7f-999b-bb8e20772712. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] Acquiring lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6eb3af0d-b80e-4a0e-84a2-90e78e09ef1f tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Port 3477becc-b128-4274-84c5-37633e88d5eb binding to destination host user is already ACTIVE {{(pid=75051) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updating instance_info_cache with network_info: [{"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Releasing lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Instance network_info: |[{"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] Acquired lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Refreshing network info cache for port 8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Start _get_guest_xml network_info=[{"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:58:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1007041992',display_name='tempest-VolumesSnapshotTestJSON-instance-1007041992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1007041992',id=20,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxqx9Eswi9QNiWDX71z3AKsYRlvGkeQDRu4A6utESLvsYaKT+8GmJNBZrp5a716eopwbfleM+IX9YSHUTiPOzTMPVhR+a4fWfe8BAkfMzEcaDSQ4SFg35dp8JP4WnuNiQ==',key_name='tempest-keypair-1123335759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-zypiafpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=3125b9f3-c96c-459f-8064-e5874d56b24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'pci_devices' on Instance uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:58:09 user nova-compute[75051]:   <uuid>3125b9f3-c96c-459f-8064-e5874d56b24a</uuid>
Nov 24 18:58:09 user nova-compute[75051]:   <name>instance-00000014</name>
Nov 24 18:58:09 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:58:09 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:58:09 user nova-compute[75051]:   <metadata>
Nov 24 18:58:09 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:58:09 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1007041992</nova:name>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:58:09</nova:creationTime>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:58:09 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:58:09 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:owner>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:user uuid="c14d0f83b34441f998e48bf56844dec8">tempest-VolumesSnapshotTestJSON-1332746489-project-member</nova:user>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:project uuid="b2ae522b213c4592acb5df152b4266a0">tempest-VolumesSnapshotTestJSON-1332746489</nova:project>
Nov 24 18:58:09 user nova-compute[75051]:       </nova:owner>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:58:09 user nova-compute[75051]:       <nova:ports>
Nov 24 18:58:09 user nova-compute[75051]:         <nova:port uuid="8a7c97d1-68a3-4b7f-999b-bb8e20772712">
Nov 24 18:58:09 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 18:58:09 user nova-compute[75051]:         </nova:port>
Nov 24 18:58:09 user nova-compute[75051]:       </nova:ports>
Nov 24 18:58:09 user nova-compute[75051]:     </nova:instance>
Nov 24 18:58:09 user nova-compute[75051]:   </metadata>
Nov 24 18:58:09 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:58:09 user nova-compute[75051]:     <system>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="serial">3125b9f3-c96c-459f-8064-e5874d56b24a</entry>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="uuid">3125b9f3-c96c-459f-8064-e5874d56b24a</entry>
Nov 24 18:58:09 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:58:09 user nova-compute[75051]:     </system>
Nov 24 18:58:09 user nova-compute[75051]:   </sysinfo>
Nov 24 18:58:09 user nova-compute[75051]:   <os>
Nov 24 18:58:09 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:58:09 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:58:09 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:58:09 user nova-compute[75051]:   </os>
Nov 24 18:58:09 user nova-compute[75051]:   <features>
Nov 24 18:58:09 user nova-compute[75051]:     <acpi/>
Nov 24 18:58:09 user nova-compute[75051]:     <apic/>
Nov 24 18:58:09 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:58:09 user nova-compute[75051]:   </features>
Nov 24 18:58:09 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:58:09 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:58:09 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:58:09 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:58:09 user nova-compute[75051]:   </clock>
Nov 24 18:58:09 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:58:09 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:58:09 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:58:09 user nova-compute[75051]:   </cpu>
Nov 24 18:58:09 user nova-compute[75051]:   <devices>
Nov 24 18:58:09 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:58:09 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:58:09 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk"/>
Nov 24 18:58:09 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:58:09 user nova-compute[75051]:     </disk>
Nov 24 18:58:09 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:58:09 user nova-compute[75051]:       <mac address="fa:16:3e:94:e7:f9"/>
Nov 24 18:58:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:09 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:58:09 user nova-compute[75051]:       <target dev="tap8a7c97d1-68"/>
Nov 24 18:58:09 user nova-compute[75051]:     </interface>
Nov 24 18:58:09 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:58:09 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/console.log" append="off"/>
Nov 24 18:58:09 user nova-compute[75051]:     </serial>
Nov 24 18:58:09 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:58:09 user nova-compute[75051]:     <video>
Nov 24 18:58:09 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:09 user nova-compute[75051]:     </video>
Nov 24 18:58:09 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:58:09 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:58:09 user nova-compute[75051]:     </rng>
Nov 24 18:58:09 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:58:09 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:58:09 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:58:09 user nova-compute[75051]:     </memballoon>
Nov 24 18:58:09 user nova-compute[75051]:   </devices>
Nov 24 18:58:09 user nova-compute[75051]: </domain>
Nov 24 18:58:09 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1007041992',display_name='tempest-VolumesSnapshotTestJSON-instance-1007041992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1007041992',id=20,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxqx9Eswi9QNiWDX71z3AKsYRlvGkeQDRu4A6utESLvsYaKT+8GmJNBZrp5a716eopwbfleM+IX9YSHUTiPOzTMPVhR+a4fWfe8BAkfMzEcaDSQ4SFg35dp8JP4WnuNiQ==',key_name='tempest-keypair-1123335759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-zypiafpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=3125b9f3-c96c-459f-8064-e5874d56b24a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG os_vif [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '467dd0cc-d3e6-519a-8031-b8da418fee75', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a7c97d1-68, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a7c97d1-68, col_values=(('qos', UUID('ec49838c-7e2b-454d-ae10-e54b53e4971b')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a7c97d1-68, col_values=(('external_ids', {'iface-id': '8a7c97d1-68a3-4b7f-999b-bb8e20772712', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:e7:f9', 'vm-uuid': '3125b9f3-c96c-459f-8064-e5874d56b24a'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: INFO os_vif [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68')
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No VIF found with MAC fa:16:3e:94:e7:f9, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updated VIF entry in instance network info cache for port 8a7c97d1-68a3-4b7f-999b-bb8e20772712. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updating instance_info_cache with network_info: [{"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e84a6fa-965d-4212-ac82-a9704cbd8195 req-a2a0ba35-da62-4846-8614-bff0a70a9032 service nova] Releasing lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Creating tmpfile /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/tmpi73nwsfe to verify with other compute node that the instance is on the same shared storage. {{(pid=75051) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG nova.compute.manager [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG nova.compute.manager [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:10 user nova-compute[75051]: WARNING nova.compute.manager [req-e3b0fa56-0209-4d8e-b75f-064b304d4a46 req-b93e3046-6300-45b3-97dc-e3cb6825c4aa service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state resized and task_state resize_reverting.
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance destroyed successfully.
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'resources' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:56:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3477becc-b1, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fcbd094-ec4d-4709-b1e4-ea7c3ea05103) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:11 user nova-compute[75051]: INFO os_vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:58:11 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487caf7-2f59-4ddc-a240-53f22a5990bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:58:11 user nova-compute[75051]: No targets found.
Nov 24 18:58:11 user nova-compute[75051]: iSNS:
Nov 24 18:58:11 user nova-compute[75051]: No targets found.
Nov 24 18:58:11 user nova-compute[75051]: STATIC:
Nov 24 18:58:11 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:58:11 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:58:11 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:58:11 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:58:11 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:58:11 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:58:11 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:58:11 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:58:11 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:58:11 user nova-compute[75051]: FIRMWARE:
Nov 24 18:58:11 user nova-compute[75051]: No targets found.
Nov 24 18:58:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:58:11 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:58:11 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[877b044e-7acd-40e9-bd39-c4d93bc4437c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d6515e-9faa-476c-848c-dcd34e20dc97]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:11 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:11 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:11 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:11 user nova-compute[75051]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c01a0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a122b71-9b0c-47fe-a7a8-269d1e4201c0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[55063386-906e-4d6b-b81b-2e0e81726914]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.039s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33015578-2836-40c2-888d-4964cba315ba]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99825c0-c604-42c5-a1a6-b950a7391856]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c087e04e-a014-41ba-8262-0372ee94fc63]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7734bc-31d4-4472-91f2-9136356e6d37]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 18:58:11 user nova-compute[75051]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 18:58:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.109s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[11415e63-1046-48ed-b326-187dd267c044]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.627s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== disconnect_volume: return (630ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:12 user nova-compute[75051]: WARNING nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state resized and task_state resize_reverting.
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] No waiting events found dispatching network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:12 user nova-compute[75051]: WARNING nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received unexpected event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 for instance with vm_state building and task_state spawning.
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] No waiting events found dispatching network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:12 user nova-compute[75051]: WARNING nova.compute.manager [req-6b592286-7663-44d1-8837-bfac26ba6f8a req-a5bb4f71-a090-4b2c-83d8-6435fc975942 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received unexpected event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 for instance with vm_state building and task_state spawning.
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk.rescue --force-share --output=json" returned: 0 in 0.289s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'migration_context' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.objects.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Object Instance<451ff98d-318a-4a05-a612-e3ce527d1164> lazy-loaded attributes: resources,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json" returned: 0 in 0.290s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json" returned: 0 in 0.272s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Instance spawned successfully.
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:58:14 user nova-compute[75051]: INFO nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Took 7.27 seconds to spawn the instance on the hypervisor.
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.522s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:14 user nova-compute[75051]: INFO nova.compute.manager [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Took 9.26 seconds to build instance.
Nov 24 18:58:14 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:14 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7498MB free_disk=25.30719757080078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aa154205-09fe-4d0d-a350-7bb9429b33fc tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.413s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:14 user nova-compute[75051]: INFO nova.compute.manager [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Swapping old allocation on dict_keys(['f8429778-9501-4346-bab2-835efc6150b7']) held by migration 1d9b8905-9432-4935-93e3-a6c38a2e9044 for instance
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:14 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:14 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1d9b8905-9432-4935-93e3-a6c38a2e9044 has allocations against this compute host but is not found in the database.
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f03918f8-eaa5-4947-96b4-a5b01cb58982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3125b9f3-c96c-459f-8064-e5874d56b24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Overwriting current allocation {'allocations': {'f8429778-9501-4346-bab2-835efc6150b7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '233bc8e889de4ee8b6a00050bee74931', 'user_id': '5e4cb3329e664cf2b3452e4107df7060', 'consumer_generation': 1} on consumer 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 24 18:58:15 user nova-compute[75051]: INFO nova.compute.manager [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Unrescuing
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.782s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG os_brick.utils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'flavor' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e6f960-0eaf-4be0-aa79-86493840fd5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67dab3-38a2-4175-9bdc-e6f5ab47d49d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f7b2a-d873-438a-8a38-70737f15cdd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df53e05e-e267-4c7a-a252-b4878089b17f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:58:16 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[38721cdf-ffe6-49a5-9cc7-66f1fc499d39]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG os_brick.utils [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:16 user nova-compute[75051]: WARNING nova.compute.manager [req-63f727a0-f81b-4c1b-9ec9-8c83beb916ac req-325fab27-9787-425d-b3d4-712dcabdf34c service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance destroyed successfully.
Nov 24 18:58:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:18 user nova-compute[75051]: WARNING nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing instance network info cache due to event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updated VIF entry in instance network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing instance network info cache due to event network-changed-b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquired lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Refreshing network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updated VIF entry in instance network info cache for port b24c4402-fb02-4205-9ee8-d414e41210ea. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:58:19 user nova-compute[75051]: DEBUG nova.network.neutron [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [{"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Releasing lock "refresh_cache-4667ca1f-edc2-49d3-a2d0-3112bf186a1d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-421e0494-2b6b-45b5-b9ea-c3d50512e5df req-7e8088f2-b397-4d06-852f-5e0c6ce0708e service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:20 user nova-compute[75051]: WARNING nova.compute.manager [req-0c99077d-e822-4ea8-a225-e71fdb59b422 req-705a4b86-3daf-4dec-b8cb-137cb51c46ed service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:58:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-053740c5-7b63-4bb4-a9be-90b8cbf1d36b tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:58:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Starting finish_revert_migration {{(pid=75051) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start _get_guest_xml network_info=[{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '451ff98d-318a-4a05-a612-e3ce527d1164', 'attached_at': '2023-11-24T18:58:23.000000', 'detached_at': '', 'volume_id': 'ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'serial': 'ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '1363b702-9742-4973-9966-1a57fb46db33', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:58:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'vcpu_model' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:58:23 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:58:23 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:58:23 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf084ec-2f67-4f7c-a661-809144dacb01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:58:23 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5bade-ac94-4163-a7bd-f76e92add962]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac] added
Nov 24 18:58:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[823081cb-1040-458b-a591-315fe0be082c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ced28e-5ca8-43bb-93ec-98c52a3c5e92]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cKhJRxIo" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73c1387-6d24-430e-b582-89abefdce289]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cKhJRxIo'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241f829-ae9e-4cee-85c1-a7262e03834a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d77782-57b9-4a24-851e-0bc4d6d8320c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:23 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:23 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[66618166-d876-427f-a7bd-2f859192a1f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 18:58:23 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 18:58:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8872f33a-4789-4eb1-8eda-735e2ea693a9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:58:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ac5b8-cb1c-4e44-a2d8-b525f6699044]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:24 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:24 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:58:24 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:58:24 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:58:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaee370-88ae-4a29-bb30-b9b4787880de]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:58:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864313363666231', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:58:25 user nova-compute[75051]:   <uuid>451ff98d-318a-4a05-a612-e3ce527d1164</uuid>
Nov 24 18:58:25 user nova-compute[75051]:   <name>instance-00000003</name>
Nov 24 18:58:25 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:58:25 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:58:25 user nova-compute[75051]:   <metadata>
Nov 24 18:58:25 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:58:25 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherB-server-1162642123</nova:name>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:58:23</nova:creationTime>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:58:25 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:58:25 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:owner>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:user uuid="5e4cb3329e664cf2b3452e4107df7060">tempest-ServerActionsTestOtherB-355305494-project-member</nova:user>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:project uuid="233bc8e889de4ee8b6a00050bee74931">tempest-ServerActionsTestOtherB-355305494</nova:project>
Nov 24 18:58:25 user nova-compute[75051]:       </nova:owner>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:58:25 user nova-compute[75051]:       <nova:ports>
Nov 24 18:58:25 user nova-compute[75051]:         <nova:port uuid="3477becc-b128-4274-84c5-37633e88d5eb">
Nov 24 18:58:25 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 18:58:25 user nova-compute[75051]:         </nova:port>
Nov 24 18:58:25 user nova-compute[75051]:       </nova:ports>
Nov 24 18:58:25 user nova-compute[75051]:     </nova:instance>
Nov 24 18:58:25 user nova-compute[75051]:   </metadata>
Nov 24 18:58:25 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:58:25 user nova-compute[75051]:     <system>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="serial">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="uuid">451ff98d-318a-4a05-a612-e3ce527d1164</entry>
Nov 24 18:58:25 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:58:25 user nova-compute[75051]:     </system>
Nov 24 18:58:25 user nova-compute[75051]:   </sysinfo>
Nov 24 18:58:25 user nova-compute[75051]:   <os>
Nov 24 18:58:25 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:58:25 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:58:25 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:58:25 user nova-compute[75051]:   </os>
Nov 24 18:58:25 user nova-compute[75051]:   <features>
Nov 24 18:58:25 user nova-compute[75051]:     <acpi/>
Nov 24 18:58:25 user nova-compute[75051]:     <apic/>
Nov 24 18:58:25 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:58:25 user nova-compute[75051]:   </features>
Nov 24 18:58:25 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:58:25 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:58:25 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:58:25 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:58:25 user nova-compute[75051]:   </clock>
Nov 24 18:58:25 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:58:25 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:58:25 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:58:25 user nova-compute[75051]:   </cpu>
Nov 24 18:58:25 user nova-compute[75051]:   <devices>
Nov 24 18:58:25 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:58:25 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:58:25 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk"/>
Nov 24 18:58:25 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:58:25 user nova-compute[75051]:     </disk>
Nov 24 18:58:25 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 18:58:25 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:58:25 user nova-compute[75051]:       <source dev="/dev/sdd"/>
Nov 24 18:58:25 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 18:58:25 user nova-compute[75051]:       <serial>ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac</serial>
Nov 24 18:58:25 user nova-compute[75051]:     </disk>
Nov 24 18:58:25 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:58:25 user nova-compute[75051]:       <mac address="fa:16:3e:84:5f:4d"/>
Nov 24 18:58:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:25 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:58:25 user nova-compute[75051]:       <target dev="tap3477becc-b1"/>
Nov 24 18:58:25 user nova-compute[75051]:     </interface>
Nov 24 18:58:25 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:58:25 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/console.log" append="off"/>
Nov 24 18:58:25 user nova-compute[75051]:     </serial>
Nov 24 18:58:25 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:58:25 user nova-compute[75051]:     <video>
Nov 24 18:58:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:25 user nova-compute[75051]:     </video>
Nov 24 18:58:25 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:58:25 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:58:25 user nova-compute[75051]:     </rng>
Nov 24 18:58:25 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:58:25 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:58:25 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:58:25 user nova-compute[75051]:     </memballoon>
Nov 24 18:58:25 user nova-compute[75051]:   </devices>
Nov 24 18:58:25 user nova-compute[75051]: </domain>
Nov 24 18:58:25 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG os_vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd68b916f-616c-5b49-80cf-8a560c842f93', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3477becc-b1, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3477becc-b1, col_values=(('qos', UUID('9248f2b3-f69d-4592-b4de-d6f0e0d39e7e')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3477becc-b1, col_values=(('external_ids', {'iface-id': '3477becc-b128-4274-84c5-37633e88d5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:5f:4d', 'vm-uuid': '451ff98d-318a-4a05-a612-e3ce527d1164'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:25 user nova-compute[75051]: INFO os_vif [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 18:58:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:26 user nova-compute[75051]: WARNING nova.compute.manager [req-92800232-46ce-4318-bd4f-4fbed4f52ef4 req-a316f071-675e-4826-9ded-fde8cce70984 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state resized and task_state resize_reverting.
Nov 24 18:58:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:28 user nova-compute[75051]: WARNING nova.compute.manager [req-093ef22f-447f-4057-aba2-4994ee83d311 req-974869c1-efdc-4b62-a613-6e0fbe535386 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state resized and task_state resize_reverting.
Nov 24 18:58:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:58:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance running successfully.
Nov 24 18:58:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] finish_revert_migration finished successfully. {{(pid=75051) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 24 18:58:29 user nova-compute[75051]: INFO nova.compute.manager [None req-9ab7cfcb-2391-429e-aa56-f42ee71e6712 tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance to original state: 'active'
Nov 24 18:58:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing instance network info cache due to event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:58:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 9ed867b7-145b-4050-8633-2d6a18689a2a {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid f03918f8-eaa5-4947-96b4-a5b01cb58982 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f059e874-6d1f-436c-a798-94426b9d6490" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.150s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.168s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.168s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated VIF entry in instance network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.203s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f059e874-6d1f-436c-a798-94426b9d6490" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.211s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e15b0cf5-32e6-4563-8b2a-7172136bcdbe req-8802eae0-27d0-49bd-82ed-a90351c5078c service nova] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:49 user nova-compute[75051]: INFO nova.compute.manager [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Detaching volume ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:58:49 user nova-compute[75051]: INFO nova.virt.block_device [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Attempting to driver detach volume ef5c1d56-3b89-45fc-95a6-2c8691784a48 from mountpoint /dev/vdb
Nov 24 18:58:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Attempting to detach device vdb from instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:58:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:58:49 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:58:49 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:58:49 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:58:49 user nova-compute[75051]:   <serial>ef5c1d56-3b89-45fc-95a6-2c8691784a48</serial>
Nov 24 18:58:49 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:58:49 user nova-compute[75051]: </disk>
Nov 24 18:58:49 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:58:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Successfully detached device vdb from instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d from the persistent domain config.
Nov 24 18:58:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:58:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:58:49 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:58:49 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:58:49 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:58:49 user nova-compute[75051]:   <serial>ef5c1d56-3b89-45fc-95a6-2c8691784a48</serial>
Nov 24 18:58:49 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:58:49 user nova-compute[75051]: </disk>
Nov 24 18:58:49 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:58:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:58:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 18:58:51 user nova-compute[75051]: INFO nova.compute.claims [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Claim successful on node user
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 18:58:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 18:58:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.policy [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21aa87c3247a4fb8acb794cff1ee372c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701cf22125304244b65b7e59708d8c50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 18:58:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Creating image(s)
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "/opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "/opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk 1073741824" returned: 0 in 0.049s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:52 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Successfully created port: 8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Cannot resize image /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Ensure instance console log exists: /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Successfully updated port: 8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquired lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-changed-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Refreshing instance network info cache due to event network-changed-8b698032-90a7-43a0-a9d5-db06e459c47c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] Acquiring lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Updating instance_info_cache with network_info: [{"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Releasing lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Instance network_info: |[{"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] Acquired lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Refreshing network info cache for port 8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Start _get_guest_xml network_info=[{"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 18:58:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894643609',display_name='tempest-ServersNegativeTestJSON-server-1894643609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894643609',id=21,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-rnmzt9j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:58:52Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=b1887a71-7d14-4889-a12d-28f3f2959e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lazy-loading 'pci_devices' on Instance uuid b1887a71-7d14-4889-a12d-28f3f2959e6a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 18:58:54 user nova-compute[75051]:   <uuid>b1887a71-7d14-4889-a12d-28f3f2959e6a</uuid>
Nov 24 18:58:54 user nova-compute[75051]:   <name>instance-00000015</name>
Nov 24 18:58:54 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 18:58:54 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 18:58:54 user nova-compute[75051]:   <metadata>
Nov 24 18:58:54 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 18:58:54 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:name>tempest-ServersNegativeTestJSON-server-1894643609</nova:name>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:creationTime>2023-11-24 18:58:54</nova:creationTime>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 18:58:54 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 18:58:54 user nova-compute[75051]:       </nova:flavor>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:owner>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:user uuid="21aa87c3247a4fb8acb794cff1ee372c">tempest-ServersNegativeTestJSON-1710506599-project-member</nova:user>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:project uuid="701cf22125304244b65b7e59708d8c50">tempest-ServersNegativeTestJSON-1710506599</nova:project>
Nov 24 18:58:54 user nova-compute[75051]:       </nova:owner>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 18:58:54 user nova-compute[75051]:       <nova:ports>
Nov 24 18:58:54 user nova-compute[75051]:         <nova:port uuid="8b698032-90a7-43a0-a9d5-db06e459c47c">
Nov 24 18:58:54 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 24 18:58:54 user nova-compute[75051]:         </nova:port>
Nov 24 18:58:54 user nova-compute[75051]:       </nova:ports>
Nov 24 18:58:54 user nova-compute[75051]:     </nova:instance>
Nov 24 18:58:54 user nova-compute[75051]:   </metadata>
Nov 24 18:58:54 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 18:58:54 user nova-compute[75051]:     <system>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="serial">b1887a71-7d14-4889-a12d-28f3f2959e6a</entry>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="uuid">b1887a71-7d14-4889-a12d-28f3f2959e6a</entry>
Nov 24 18:58:54 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 18:58:54 user nova-compute[75051]:     </system>
Nov 24 18:58:54 user nova-compute[75051]:   </sysinfo>
Nov 24 18:58:54 user nova-compute[75051]:   <os>
Nov 24 18:58:54 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 18:58:54 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 18:58:54 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 18:58:54 user nova-compute[75051]:   </os>
Nov 24 18:58:54 user nova-compute[75051]:   <features>
Nov 24 18:58:54 user nova-compute[75051]:     <acpi/>
Nov 24 18:58:54 user nova-compute[75051]:     <apic/>
Nov 24 18:58:54 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 18:58:54 user nova-compute[75051]:   </features>
Nov 24 18:58:54 user nova-compute[75051]:   <clock offset="utc">
Nov 24 18:58:54 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 18:58:54 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 18:58:54 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 18:58:54 user nova-compute[75051]:   </clock>
Nov 24 18:58:54 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 18:58:54 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 18:58:54 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 18:58:54 user nova-compute[75051]:   </cpu>
Nov 24 18:58:54 user nova-compute[75051]:   <devices>
Nov 24 18:58:54 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 18:58:54 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 18:58:54 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk"/>
Nov 24 18:58:54 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 18:58:54 user nova-compute[75051]:     </disk>
Nov 24 18:58:54 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 18:58:54 user nova-compute[75051]:       <mac address="fa:16:3e:53:b0:5c"/>
Nov 24 18:58:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:54 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 18:58:54 user nova-compute[75051]:       <target dev="tap8b698032-90"/>
Nov 24 18:58:54 user nova-compute[75051]:     </interface>
Nov 24 18:58:54 user nova-compute[75051]:     <serial type="pty">
Nov 24 18:58:54 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/console.log" append="off"/>
Nov 24 18:58:54 user nova-compute[75051]:     </serial>
Nov 24 18:58:54 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 18:58:54 user nova-compute[75051]:     <video>
Nov 24 18:58:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 18:58:54 user nova-compute[75051]:     </video>
Nov 24 18:58:54 user nova-compute[75051]:     <rng model="virtio">
Nov 24 18:58:54 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 18:58:54 user nova-compute[75051]:     </rng>
Nov 24 18:58:54 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 18:58:54 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 18:58:54 user nova-compute[75051]:       <stats period="10"/>
Nov 24 18:58:54 user nova-compute[75051]:     </memballoon>
Nov 24 18:58:54 user nova-compute[75051]:   </devices>
Nov 24 18:58:54 user nova-compute[75051]: </domain>
Nov 24 18:58:54 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894643609',display_name='tempest-ServersNegativeTestJSON-server-1894643609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894643609',id=21,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-rnmzt9j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T18:58:52Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=b1887a71-7d14-4889-a12d-28f3f2959e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG os_vif [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f624b16d-a460-5d11-b4c8-254f7ff1b237', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b698032-90, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b698032-90, col_values=(('qos', UUID('53b63313-1318-4abc-a86b-fb527f2c382e')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b698032-90, col_values=(('external_ids', {'iface-id': '8b698032-90a7-43a0-a9d5-db06e459c47c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b0:5c', 'vm-uuid': 'b1887a71-7d14-4889-a12d-28f3f2959e6a'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:54 user nova-compute[75051]: INFO os_vif [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90')
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] No VIF found with MAC fa:16:3e:53:b0:5c, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Updated VIF entry in instance network info cache for port 8b698032-90a7-43a0-a9d5-db06e459c47c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Updating instance_info_cache with network_info: [{"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:58:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aae0351b-f099-49f0-a0a9-cfc6041a359b req-bf06007e-3a94-4dcd-b7af-df8239d55f71 service nova] Releasing lock "refresh_cache-b1887a71-7d14-4889-a12d-28f3f2959e6a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:58:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] No waiting events found dispatching network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:56 user nova-compute[75051]: WARNING nova.compute.manager [req-aca18f38-e843-4427-aef4-53d6d6d7ee21 req-bdd9fc31-fa0c-44de-8f94-54e96aa8dfad service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received unexpected event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c for instance with vm_state building and task_state spawning.
Nov 24 18:58:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 18:58:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Instance spawned successfully.
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] No waiting events found dispatching network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:58:58 user nova-compute[75051]: WARNING nova.compute.manager [req-3fd096b3-fb43-4af4-8fa8-540b920818a9 req-fc052924-6da4-4039-8eed-ad0a65427e38 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received unexpected event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c for instance with vm_state building and task_state spawning.
Nov 24 18:58:58 user nova-compute[75051]: INFO nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 24 18:58:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:58:58 user nova-compute[75051]: INFO nova.compute.manager [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Took 6.86 seconds to build instance.
Nov 24 18:58:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-31994789-2040-4123-bc87-986657aebb4c tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.090s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:58:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:07 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d is timed out.
Nov 24 18:59:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Successfully detached device vdb from instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d from the live domain config.
Nov 24 18:59:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRIKPvUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[429cf098-e7b1-4640-8003-c4c091c71273]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 18:59:10 user nova-compute[75051]: No targets found.
Nov 24 18:59:10 user nova-compute[75051]: iSNS:
Nov 24 18:59:10 user nova-compute[75051]: No targets found.
Nov 24 18:59:10 user nova-compute[75051]: STATIC:
Nov 24 18:59:10 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 18:59:10 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:59:10 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:59:10 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8
Nov 24 18:59:10 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:59:10 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:59:10 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 18:59:10 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:59:10 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:59:10 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48
Nov 24 18:59:10 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 18:59:10 user nova-compute[75051]:                 Iface Name: default
Nov 24 18:59:10 user nova-compute[75051]: FIRMWARE:
Nov 24 18:59:10 user nova-compute[75051]: No targets found.
Nov 24 18:59:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 18:59:10 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 18:59:10 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a4946-0924-491f-b7d7-009dfb3c5b52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e362a-8780-45cd-9db8-b743ae37b909]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:10 user nova-compute[75051]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07d1b59b-8454-4a2c-8be9-46cb732c60f8 (non-flash)
Nov 24 18:59:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b8337d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[226ef661-af9b-4935-a562-4947a94585dd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4bc84a-4fba-4e67-9788-ec422aff657c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caef122-c40e-4bc1-bbbf-3ba1658c38d5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7720c1-02c1-4fe5-b2cf-491fb4c22db6]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[deceb8fa-6218-4557-b9d2-518fb62e2090]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc22cef-45ac-42a9-99c2-ebde15017109]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260]
Nov 24 18:59:10 user nova-compute[75051]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48, portal: 172.16.0.220,3260] successful.
Nov 24 18:59:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef5c1d56-3b89-45fc-95a6-2c8691784a48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b604c3-0320-43ad-b289-bca9c154d9c7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] <== disconnect_volume: return (383ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:59:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'flavor' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6f7f3256-2292-4470-bff1-3885e179b9e0 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.463s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:59:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7130MB free_disk=25.236831665039062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f03918f8-eaa5-4947-96b4-a5b01cb58982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3125b9f3-c96c-459f-8064-e5874d56b24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b1887a71-7d14-4889-a12d-28f3f2959e6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 18:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:59:14 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [{"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-451ff98d-318a-4a05-a612-e3ce527d1164" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 18:59:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 18:59:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-changed-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Refreshing instance network info cache due to event network-changed-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:59:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] Acquiring lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:59:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] Acquired lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:59:21 user nova-compute[75051]: DEBUG nova.network.neutron [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Refreshing network info cache for port 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:59:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updated VIF entry in instance network info cache for port 69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:59:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating instance_info_cache with network_info: [{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaa1c164-6ee5-4ec1-9f96-c735d331fd05 req-474c76dd-85eb-4d0c-a477-c134a7c9fcd1 service nova] Releasing lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:59:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:25 user nova-compute[75051]: INFO nova.compute.manager [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attaching volume e08a9f6b-5131-4325-9135-fb1c7288caee to /dev/vdb
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e331ec83-a42a-4180-a517-2d0ccecf1731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6309e0c8-0931-4b88-9703-2b9c3b0f0f27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c18ca4-decb-468a-8b0f-f60d6b7a9052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a251d05b-b5ed-47aa-9663-12f1b93cc93f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:26 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:59:26 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3891a3-02f9-4188-84fc-71a71b890576]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG os_brick.utils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:26 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating existing volume attachment record: 501ab9a1-a64c-4ab9-86fa-1aaefe975e17 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:59:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkdAKqZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:32 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:59:32 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:59:32 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21004f0d-3f7e-4736-bb4a-146a2314db4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:59:32 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c1af6a-ab76-4f21-8b24-d94db9d4c63a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee] added
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aacad1-fc6a-4484-ac37-b6f880ba8a5e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[029e6900-36b2-4945-afaf-e058f46ede13]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkdAKqZa {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MkdAKqZa" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d025a-739a-4e30-b1cb-1a91f34a7ee6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MkdAKqZa'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda806ca-87b2-4e09-929c-2a5833f25ed2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39ba20-1406-4644-b10d-42571b306a9c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6003dfb8-ee8a-4b53-a616-ef0783e9000d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260]
Nov 24 18:59:32 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260] successful.
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564b4cb-958e-42dd-8bf4-fbdab9ede534]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c3eb5-d2bb-4e62-a7ad-69cd3508b6a3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:32 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:32 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[235d63ad-bb14-432c-82e0-d251e2ca7426]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:59:32 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkdAKqZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26335336230656336', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335336230656336', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:59:33 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:33 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:59:33 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:33 user nova-compute[75051]:   <serial>e08a9f6b-5131-4325-9135-fb1c7288caee</serial>
Nov 24 18:59:33 user nova-compute[75051]: </disk>
Nov 24 18:59:33 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:59:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No VIF found with MAC fa:16:3e:93:f0:e2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:59:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c86a4d93-70d2-492f-b1d4-c9babc491790 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.171s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-changed-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Refreshing instance network info cache due to event network-changed-7d0f55b7-14e8-46af-b3d8-214a3ec965bb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] Acquiring lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] Acquired lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Refreshing network info cache for port 7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updated VIF entry in instance network info cache for port 7d0f55b7-14e8-46af-b3d8-214a3ec965bb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG nova.network.neutron [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updating instance_info_cache with network_info: [{"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31ca2de7-a237-4861-8476-6312a9b11cd2 req-5e05ead8-d74c-4b47-a1c8-f78bb792cd37 service nova] Releasing lock "refresh_cache-59738ebd-376f-4f6b-b9e5-3177010fc54e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:59:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG nova.objects.instance [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'flavor' on Instance uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:39 user nova-compute[75051]: INFO nova.compute.manager [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Attaching volume 86ccbabc-0b57-4905-926a-f45e6756dfda to /dev/vdb
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.utils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc96f97-8d67-45d9-8654-625ec2d64cb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d9b563-daf6-4d07-8339-b5e9ec5d0c9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a57c73-2591-47c0-b04b-17344932ca03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8274b18f-8538-4799-a072-61ceb2fae7a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:39 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:59:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec983f-4908-4678-afdb-281540ba317e]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG os_brick.utils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updating existing volume attachment record: 293de556-4fb6-4c6f-9c39-441bf8ca310b {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:59:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:40 user nova-compute[75051]: INFO nova.compute.manager [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Terminating instance
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-f3be035f-8647-46af-8b7e-35b42fb5e965 req-d2498e36-ff28-4e30-b276-27457db45ada service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-unplugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:59:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Instance destroyed successfully.
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lazy-loading 'resources' on Instance uuid 4667ca1f-edc2-49d3-a2d0-3112bf186a1d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1631843319',display_name='tempest-ServerStableDeviceRescueTest-server-1631843319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1631843319',id=4,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHp6SKZOIk+xReUl8mqhN/wc+R9+FUSmRXe8SoZ5JpOd1MFMSYZgsTsZKQs9P3kqS/r0bz/IP7rh+BDsdP1qH9x/syg2R/G2CIjxRgK03I7wiQ4OP1cOL3umm3BIS5g18w==',key_name='tempest-keypair-991358245',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fa4b8bd2840427cbbc401ebe27fd1ef',ramdisk_id='',reservation_id='r-4cvaj118',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1493484384',owner_user_name='tempest-ServerStableDeviceRescueTest-1493484384-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53abab4c5b7b48e0a4a857472ed46245',uuid=4667ca1f-edc2-49d3-a2d0-3112bf186a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converting VIF {"id": "b24c4402-fb02-4205-9ee8-d414e41210ea", "address": "fa:16:3e:b9:41:3d", "network": {"id": "fbce7561-6d76-49f0-a297-2cf974d65274", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1253299566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fa4b8bd2840427cbbc401ebe27fd1ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb24c4402-fb", "ovs_interfaceid": "b24c4402-fb02-4205-9ee8-d414e41210ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG os_vif [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb24c4402-fb, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2a8e821-c471-49ce-a386-e707ad4d3ba3) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:40 user nova-compute[75051]: INFO os_vif [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:41:3d,bridge_name='br-int',has_traffic_filtering=True,id=b24c4402-fb02-4205-9ee8-d414e41210ea,network=Network(fbce7561-6d76-49f0-a297-2cf974d65274),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb24c4402-fb')
Nov 24 18:59:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Deleting instance files /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d_del
Nov 24 18:59:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Deletion of /opt/stack/data/nova/instances/4667ca1f-edc2-49d3-a2d0-3112bf186a1d_del complete
Nov 24 18:59:40 user nova-compute[75051]: INFO nova.compute.manager [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 24 18:59:40 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:59:40 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:59:41 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:41 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Took 0.99 seconds to deallocate network for instance.
Nov 24 18:59:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-4223018d-74ba-48ce-a518-14ac1cf85628 req-4e99c311-db5d-485e-805b-e96446a67954 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-deleted-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] Acquiring lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] No waiting events found dispatching network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:42 user nova-compute[75051]: WARNING nova.compute.manager [req-b2396a33-5ab1-42e8-8236-4f0fb4a8d463 req-3377314f-cce9-499b-a67d-261d0f576299 service nova] [instance: 4667ca1f-edc2-49d3-a2d0-3112bf186a1d] Received unexpected event network-vif-plugged-b24c4402-fb02-4205-9ee8-d414e41210ea for instance with vm_state deleted and task_state None.
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:42 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Deleted allocations for instance 4667ca1f-edc2-49d3-a2d0-3112bf186a1d
Nov 24 18:59:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-081710b6-38bb-4b59-8b4f-7f6c7903ba62 tempest-ServerStableDeviceRescueTest-1493484384 tempest-ServerStableDeviceRescueTest-1493484384-project-member] Lock "4667ca1f-edc2-49d3-a2d0-3112bf186a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwNxkXac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:59:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 18:59:45 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[77026406-fbd3-4c08-94c7-dcb3f7b2fbfd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 18:59:45 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafbfbd9-e4b1-48dd-bcfa-0cabc8cae4f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda] added
Nov 24 18:59:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3633ae-7d84-48a6-a936-f89173752e9c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0042303-c16b-4f33-bc83-574848d29d7c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwNxkXac {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zwNxkXac" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6f3da2-4c35-412c-8f34-48bf88d92b58]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zwNxkXac'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d22d10b-f3dc-4580-95c3-0ae525ef7ae3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[340f3391-4bec-45bb-bb5d-403c5badc49f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdc82bc-9f29-484a-94fa-fe48d8c08301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260]
Nov 24 18:59:46 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260] successful.
Nov 24 18:59:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec420c-d1f7-4fb8-9d56-127dd84c775b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f34ec4a-3ada-49e7-8941-baa209765327]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 18:59:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 18:59:46 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 18:59:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b59d5d9-fe77-40df-b6ab-0ae7aac05619]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwNxkXac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26231626133326634', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231626133326634', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.objects.instance [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'flavor' on Instance uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 18:59:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:47 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 18:59:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:47 user nova-compute[75051]:   <serial>86ccbabc-0b57-4905-926a-f45e6756dfda</serial>
Nov 24 18:59:47 user nova-compute[75051]: </disk>
Nov 24 18:59:47 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:47 user nova-compute[75051]: INFO nova.compute.manager [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Detaching volume e08a9f6b-5131-4325-9135-fb1c7288caee
Nov 24 18:59:47 user nova-compute[75051]: INFO nova.virt.block_device [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attempting to driver detach volume e08a9f6b-5131-4325-9135-fb1c7288caee from mountpoint /dev/vdb
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Attempting to detach device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:59:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:47 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:59:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:47 user nova-compute[75051]:   <serial>e08a9f6b-5131-4325-9135-fb1c7288caee</serial>
Nov 24 18:59:47 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:59:47 user nova-compute[75051]: </disk>
Nov 24 18:59:47 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:59:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config.
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:59:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:47 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 18:59:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:47 user nova-compute[75051]:   <serial>e08a9f6b-5131-4325-9135-fb1c7288caee</serial>
Nov 24 18:59:47 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:59:47 user nova-compute[75051]: </disk>
Nov 24 18:59:47 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No VIF found with MAC fa:16:3e:32:3a:cc, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-025381a1-3bfd-4b2a-acdb-47ad3c51d9e3 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.498s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:47 user nova-compute[75051]: INFO nova.compute.manager [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Terminating instance
Nov 24 18:59:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-unplugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] No waiting events found dispatching network-vif-unplugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-aba6d08b-7eca-429e-b81b-838321902efd req-fcb79de9-ef18-4881-8f11-4f350d39f99a service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-unplugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Instance destroyed successfully.
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lazy-loading 'resources' on Instance uuid f03918f8-eaa5-4947-96b4-a5b01cb58982 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-720651679',display_name='tempest-VolumesActionsTest-instance-720651679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-720651679',id=19,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19f5348de50a4a45a1ead31a1865a687',ramdisk_id='',reservation_id='r-6e214ujk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-608271058',owner_user_name='tempest-VolumesActionsTest-608271058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:57:59Z,user_data=None,user_id='1d258dfa49264233b121b20e2a59ee09',uuid=f03918f8-eaa5-4947-96b4-a5b01cb58982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converting VIF {"id": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "address": "fa:16:3e:97:5c:60", "network": {"id": "61ca0d61-17b4-4390-b919-5378f7561689", "bridge": "br-int", "label": "tempest-VolumesActionsTest-631227365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19f5348de50a4a45a1ead31a1865a687", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa72270d5-0f", "ovs_interfaceid": "a72270d5-0fe6-412c-aa0c-0aa2df8e12d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG os_vif [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa72270d5-0f, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.compute.manager [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Detaching volume 86ccbabc-0b57-4905-926a-f45e6756dfda
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cf24ccd-5bb3-4897-9785-375156e7034d) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:48 user nova-compute[75051]: INFO os_vif [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:5c:60,bridge_name='br-int',has_traffic_filtering=True,id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8,network=Network(61ca0d61-17b4-4390-b919-5378f7561689),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa72270d5-0f')
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Deleting instance files /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982_del
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Deletion of /opt/stack/data/nova/instances/f03918f8-eaa5-4947-96b4-a5b01cb58982_del complete
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.virt.block_device [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Attempting to driver detach volume 86ccbabc-0b57-4905-926a-f45e6756dfda from mountpoint /dev/vdb
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.compute.manager [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 24 18:59:48 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Attempting to detach device vdb from instance 59738ebd-376f-4f6b-b9e5-3177010fc54e from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:59:48 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:48 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 18:59:48 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:48 user nova-compute[75051]:   <serial>86ccbabc-0b57-4905-926a-f45e6756dfda</serial>
Nov 24 18:59:48 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:59:48 user nova-compute[75051]: </disk>
Nov 24 18:59:48 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:59:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully detached device vdb from instance 59738ebd-376f-4f6b-b9e5-3177010fc54e from the persistent domain config.
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59738ebd-376f-4f6b-b9e5-3177010fc54e from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 18:59:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 18:59:48 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 18:59:48 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 18:59:48 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 18:59:48 user nova-compute[75051]:   <serial>86ccbabc-0b57-4905-926a-f45e6756dfda</serial>
Nov 24 18:59:48 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 18:59:48 user nova-compute[75051]: </disk>
Nov 24 18:59:48 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:49 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Took 0.49 seconds to deallocate network for instance.
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-51913a75-ee10-4dcb-a893-658f3e073044 req-123177a0-3ce5-42dc-8a9d-684555ce4865 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-deleted-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:49 user nova-compute[75051]: INFO nova.compute.manager [req-51913a75-ee10-4dcb-a893-658f3e073044 req-123177a0-3ce5-42dc-8a9d-684555ce4865 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Neutron deleted interface a72270d5-0fe6-412c-aa0c-0aa2df8e12d8; detaching it from the instance and deleting it from the info cache
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-51913a75-ee10-4dcb-a893-658f3e073044 req-123177a0-3ce5-42dc-8a9d-684555ce4865 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-51913a75-ee10-4dcb-a893-658f3e073044 req-123177a0-3ce5-42dc-8a9d-684555ce4865 service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Detach interface failed, port_id=a72270d5-0fe6-412c-aa0c-0aa2df8e12d8, reason: Instance f03918f8-eaa5-4947-96b4-a5b01cb58982 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 18:59:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:49 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Deleted allocations for instance f03918f8-eaa5-4947-96b4-a5b01cb58982
Nov 24 18:59:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b3e8f90-9cd1-4137-a167-c68668caf3ce tempest-VolumesActionsTest-608271058 tempest-VolumesActionsTest-608271058-project-member] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] Acquiring lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] Lock "f03918f8-eaa5-4947-96b4-a5b01cb58982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] No waiting events found dispatching network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:50 user nova-compute[75051]: WARNING nova.compute.manager [req-56c29cb6-1a2a-4105-a2cb-fef807ca2542 req-ab66c0fb-0e9e-4287-b3fb-85e2f5a99ecf service nova] [instance: f03918f8-eaa5-4947-96b4-a5b01cb58982] Received unexpected event network-vif-plugged-a72270d5-0fe6-412c-aa0c-0aa2df8e12d8 for instance with vm_state deleted and task_state None.
Nov 24 18:59:50 user nova-compute[75051]: INFO nova.compute.manager [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Unrescuing
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'flavor' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:51 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance destroyed successfully.
Nov 24 18:59:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:52 user nova-compute[75051]: WARNING nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:59:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:52 user nova-compute[75051]: WARNING nova.compute.manager [req-7b1dfc42-182c-49d3-843f-7f34c4a0208b req-fede4871-2935-453b-aaff-45440e24c849 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:59:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:54 user nova-compute[75051]: WARNING nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:59:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 18:59:54 user nova-compute[75051]: WARNING nova.compute.manager [req-c29e7ca7-ce2e-4674-aef3-036d66ba106b req-b9cc5c36-239f-4940-a9dd-4ff2e148a364 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state rescued and task_state unrescuing.
Nov 24 18:59:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6030456d-5159-4fe1-8eeb-af8bd0f35d85 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-changed-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Refreshing instance network info cache due to event network-changed-8a7c97d1-68a3-4b7f-999b-bb8e20772712. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] Acquiring lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] Acquired lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.network.neutron [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Refreshing network info cache for port 8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 18:59:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Ignoring supplied device name: /dev/vdb
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.network.neutron [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updated VIF entry in instance network info cache for port 8a7c97d1-68a3-4b7f-999b-bb8e20772712. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG nova.network.neutron [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updating instance_info_cache with network_info: [{"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 18:59:56 user nova-compute[75051]: INFO nova.compute.manager [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Attaching volume 71927b99-fe8a-4deb-9b21-4352ec18872a to /dev/vdb
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2ffb8b80-8277-48d8-8783-43a9325e0ee3 req-c94dd6d9-7c84-4689-98dd-3b137b34d405 service nova] Releasing lock "refresh_cache-3125b9f3-c96c-459f-8064-e5874d56b24a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG os_brick.utils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[398859b9-4acb-46d7-9683-b7acc1ac8f37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec15093-fa31-4b5c-97a0-f5756ed4db73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a7240-1984-440e-ae04-f96924a17acd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3add9fdc-d997-45b3-bca9-6b18085f9de5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 18:59:57 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 18:59:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b81ae4-06e6-4d60-b3ac-672636089b36]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG os_brick.utils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 18:59:57 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updating existing volume attachment record: 62ed0455-ce5c-4c2f-8b0f-f42cf123534b {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 18:59:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVowLiaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:03 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:03 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:03 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3d1bec-9d80-474f-9928-8cd109320696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:00:03 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[98933806-daa2-40aa-9061-8185c5c38f78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a] added
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[78408f52-53db-454f-b1e2-fe7fc45fc47f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c7253c-8e6f-4733-9c6d-06a8168f469b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVowLiaZ {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BVowLiaZ" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101ff7e-ec1c-4b9e-802b-8219833b64cc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BVowLiaZ'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20401383-765b-4430-8a71-a20c059763f2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b6c8d9-6f93-43d3-a651-b12561e4a5d0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f0cd0-5132-40ca-b295-26e750e21e52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260]
Nov 24 19:00:03 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260] successful.
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259589b-64d7-4cd7-a6ac-65de0c22602a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273fc93-6041-4c13-9e12-c78b9e15fc96]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:03 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[831622db-788b-4834-aa55-857d14742dec]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVowLiaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:00:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26531666135333932', 'path': '/dev/sdf'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531666135333932', 'path': '/dev/sdf'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:00:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:00:04 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:04 user nova-compute[75051]:   <source dev="/dev/sdf"/>
Nov 24 19:00:04 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:04 user nova-compute[75051]:   <serial>71927b99-fe8a-4deb-9b21-4352ec18872a</serial>
Nov 24 19:00:04 user nova-compute[75051]: </disk>
Nov 24 19:00:04 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:00:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] No VIF found with MAC fa:16:3e:94:e7:f9, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-164e0070-e4d8-47ae-9fae-5e754738e55a tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.454s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 is timed out.
Nov 24 19:00:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config.
Nov 24 19:00:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MkdAKqZa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:08 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[df11dbf8-58b5-4016-abc1-8a0868282b84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:00:08 user nova-compute[75051]: No targets found.
Nov 24 19:00:08 user nova-compute[75051]: iSNS:
Nov 24 19:00:08 user nova-compute[75051]: No targets found.
Nov 24 19:00:08 user nova-compute[75051]: STATIC:
Nov 24 19:00:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee
Nov 24 19:00:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:00:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a
Nov 24 19:00:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 19:00:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda
Nov 24 19:00:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:08 user nova-compute[75051]: FIRMWARE:
Nov 24 19:00:08 user nova-compute[75051]: No targets found.
Nov 24 19:00:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:00:08 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:00:08 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c04f3e-8c88-4f91-8dbb-64dbcffc0a19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429d2eb-cd67-44c9-b7cf-233da4dfc95c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:08 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0441a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814cf05-b0ce-4f28-a619-2d6da1570c95]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[99429d68-5629-4b02-8c4f-1f7d5ec4e1c2]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[209210b3-f28f-474b-848f-4e40d0358de3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d5af0-9e38-4172-97ac-ca7779ed8017]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87257dca-dc3a-454d-8b83-9d8b29e54bd4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[686918b6-afa3-474b-b883-039d5eb87124]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260]
Nov 24 19:00:08 user nova-compute[75051]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee, portal: 172.16.0.220,3260] successful.
Nov 24 19:00:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08a9f6b-5131-4325-9135-fb1c7288caee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a9962-09a7-477e-97fc-67b56dd9246c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== disconnect_volume: return (301ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:00:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-66367815-0dab-4430-a158-1221d2756705 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:09 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 59738ebd-376f-4f6b-b9e5-3177010fc54e is timed out.
Nov 24 19:00:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully detached device vdb from instance 59738ebd-376f-4f6b-b9e5-3177010fc54e from the live domain config.
Nov 24 19:00:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zwNxkXac', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:09 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfbeaaf-7700-48ab-b0f1-8855e8a0a9ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:00:09 user nova-compute[75051]: No targets found.
Nov 24 19:00:09 user nova-compute[75051]: iSNS:
Nov 24 19:00:09 user nova-compute[75051]: No targets found.
Nov 24 19:00:09 user nova-compute[75051]: STATIC:
Nov 24 19:00:09 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:00:09 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:09 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:09 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a
Nov 24 19:00:09 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:09 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:09 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 19:00:09 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:09 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:09 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda
Nov 24 19:00:09 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:09 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:09 user nova-compute[75051]: FIRMWARE:
Nov 24 19:00:09 user nova-compute[75051]: No targets found.
Nov 24 19:00:09 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:00:09 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:00:09 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e9167-c5e6-4155-98f9-2f45ca70de5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a6c971-e742-4496-8669-51f5a9516298]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:09 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda (non-flash)
Nov 24 19:00:09 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:09 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b839f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2d9d7a-4c7b-4dad-9462-0de8a708ee0f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee576daa-c9d1-475f-9c31-1b824a4abed4]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ffe7e3-d330-4061-b2e8-cb3bde419969]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57b7686-6aee-4d00-ade8-90beeb298430]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25956c27-6c47-4c69-9ec1-7c8e7ab8260b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[998d82e1-1bb5-4fcb-8037-7609f877c363]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260]
Nov 24 19:00:09 user nova-compute[75051]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda, portal: 172.16.0.220,3260] successful.
Nov 24 19:00:09 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ccbabc-0b57-4905-926a-f45e6756dfda -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c83794-5ecc-427b-8602-043587bf2688]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] <== disconnect_volume: return (312ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:09 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'flavor' on Instance uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c37fc0f5-e368-4463-a02b-78c4ded19e48 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:00:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7751MB free_disk=25.35162353515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 451ff98d-318a-4a05-a612-e3ce527d1164 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3125b9f3-c96c-459f-8064-e5874d56b24a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b1887a71-7d14-4889-a12d-28f3f2959e6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:00:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:00:14 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:00:14 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:00:14 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:00:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:00:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:21 user nova-compute[75051]: INFO nova.compute.manager [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Detaching volume 71927b99-fe8a-4deb-9b21-4352ec18872a
Nov 24 19:00:21 user nova-compute[75051]: INFO nova.virt.block_device [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Attempting to driver detach volume 71927b99-fe8a-4deb-9b21-4352ec18872a from mountpoint /dev/vdb
Nov 24 19:00:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Attempting to detach device vdb from instance 3125b9f3-c96c-459f-8064-e5874d56b24a from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:00:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:00:21 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:21 user nova-compute[75051]:   <source dev="/dev/sdf"/>
Nov 24 19:00:21 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:21 user nova-compute[75051]:   <serial>71927b99-fe8a-4deb-9b21-4352ec18872a</serial>
Nov 24 19:00:21 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:00:21 user nova-compute[75051]: </disk>
Nov 24 19:00:21 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:00:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully detached device vdb from instance 3125b9f3-c96c-459f-8064-e5874d56b24a from the persistent domain config.
Nov 24 19:00:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3125b9f3-c96c-459f-8064-e5874d56b24a from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:00:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:00:21 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:21 user nova-compute[75051]:   <source dev="/dev/sdf"/>
Nov 24 19:00:21 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:21 user nova-compute[75051]:   <serial>71927b99-fe8a-4deb-9b21-4352ec18872a</serial>
Nov 24 19:00:21 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:00:21 user nova-compute[75051]: </disk>
Nov 24 19:00:21 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:00:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:00:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:00:34 user nova-compute[75051]: INFO nova.compute.claims [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Claim successful on node user
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:00:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.policy [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1542a899903c40dfba0d4b274b547b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5e7665a994fe29c206c1b53c5359f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:00:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Creating image(s)
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk 1073741824" returned: 0 in 0.050s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Cannot resize image /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Ensure instance console log exists: /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Successfully created port: c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Successfully updated port: c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-changed-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Refreshing instance network info cache due to event network-changed-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] Acquiring lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating instance_info_cache with network_info: [{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance network_info: |[{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] Acquired lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.neutron [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Refreshing network info cache for port c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start _get_guest_xml network_info=[{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:00:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-tempest.common.compute-instance-934943927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'pci_devices' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:00:37 user nova-compute[75051]:   <uuid>9359be0c-8d4b-4a3a-b2a6-371f108f39db</uuid>
Nov 24 19:00:37 user nova-compute[75051]:   <name>instance-00000016</name>
Nov 24 19:00:37 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:00:37 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:00:37 user nova-compute[75051]:   <metadata>
Nov 24 19:00:37 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:00:37 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:name>tempest-tempest.common.compute-instance-934943927</nova:name>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:00:37</nova:creationTime>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:00:37 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:00:37 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:owner>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:user uuid="1542a899903c40dfba0d4b274b547b73">tempest-ServerActionsTestOtherA-214702841-project-member</nova:user>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:project uuid="9ae5e7665a994fe29c206c1b53c5359f">tempest-ServerActionsTestOtherA-214702841</nova:project>
Nov 24 19:00:37 user nova-compute[75051]:       </nova:owner>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:00:37 user nova-compute[75051]:       <nova:ports>
Nov 24 19:00:37 user nova-compute[75051]:         <nova:port uuid="c481b3ac-4641-4ab8-a878-9fb3b90ad8f0">
Nov 24 19:00:37 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:00:37 user nova-compute[75051]:         </nova:port>
Nov 24 19:00:37 user nova-compute[75051]:       </nova:ports>
Nov 24 19:00:37 user nova-compute[75051]:     </nova:instance>
Nov 24 19:00:37 user nova-compute[75051]:   </metadata>
Nov 24 19:00:37 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:00:37 user nova-compute[75051]:     <system>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="serial">9359be0c-8d4b-4a3a-b2a6-371f108f39db</entry>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="uuid">9359be0c-8d4b-4a3a-b2a6-371f108f39db</entry>
Nov 24 19:00:37 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:00:37 user nova-compute[75051]:     </system>
Nov 24 19:00:37 user nova-compute[75051]:   </sysinfo>
Nov 24 19:00:37 user nova-compute[75051]:   <os>
Nov 24 19:00:37 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:00:37 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:00:37 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:00:37 user nova-compute[75051]:   </os>
Nov 24 19:00:37 user nova-compute[75051]:   <features>
Nov 24 19:00:37 user nova-compute[75051]:     <acpi/>
Nov 24 19:00:37 user nova-compute[75051]:     <apic/>
Nov 24 19:00:37 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:00:37 user nova-compute[75051]:   </features>
Nov 24 19:00:37 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:00:37 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:00:37 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:00:37 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:00:37 user nova-compute[75051]:   </clock>
Nov 24 19:00:37 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:00:37 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:00:37 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:00:37 user nova-compute[75051]:   </cpu>
Nov 24 19:00:37 user nova-compute[75051]:   <devices>
Nov 24 19:00:37 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:00:37 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:00:37 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk"/>
Nov 24 19:00:37 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:00:37 user nova-compute[75051]:     </disk>
Nov 24 19:00:37 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:00:37 user nova-compute[75051]:       <mac address="fa:16:3e:df:67:89"/>
Nov 24 19:00:37 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:00:37 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:00:37 user nova-compute[75051]:       <target dev="tapc481b3ac-46"/>
Nov 24 19:00:37 user nova-compute[75051]:     </interface>
Nov 24 19:00:37 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:00:37 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/console.log" append="off"/>
Nov 24 19:00:37 user nova-compute[75051]:     </serial>
Nov 24 19:00:37 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:00:37 user nova-compute[75051]:     <video>
Nov 24 19:00:37 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:00:37 user nova-compute[75051]:     </video>
Nov 24 19:00:37 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:00:37 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:00:37 user nova-compute[75051]:     </rng>
Nov 24 19:00:37 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:00:37 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:00:37 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:00:37 user nova-compute[75051]:     </memballoon>
Nov 24 19:00:37 user nova-compute[75051]:   </devices>
Nov 24 19:00:37 user nova-compute[75051]: </domain>
Nov 24 19:00:37 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-tempest.common.compute-instance-934943927',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG os_vif [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adb622b5-ed78-5d71-9e4e-50aa3a014a4d', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc481b3ac-46, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc481b3ac-46, col_values=(('qos', UUID('c2e985de-bd15-46c7-b043-8207e371ee72')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc481b3ac-46, col_values=(('external_ids', {'iface-id': 'c481b3ac-4641-4ab8-a878-9fb3b90ad8f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:67:89', 'vm-uuid': '9359be0c-8d4b-4a3a-b2a6-371f108f39db'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:37 user nova-compute[75051]: INFO os_vif [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46')
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:df:67:89, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.neutron [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updated VIF entry in instance network info cache for port c481b3ac-4641-4ab8-a878-9fb3b90ad8f0. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG nova.network.neutron [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating instance_info_cache with network_info: [{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-646b0c0b-e60e-4969-9bb8-936640ad3ab6 req-92330483-51f6-4020-9313-2aefb1c81f9a service nova] Releasing lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:38 user nova-compute[75051]: WARNING nova.compute.manager [req-11a66f80-2706-4484-9259-08eb33f03422 req-9f1fd006-20ee-4cc9-ba53-8593fa724e84 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state building and task_state spawning.
Nov 24 19:00:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.compute.claims [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Claim successful on node user
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance spawned successfully.
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.compute.manager [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attaching volume ce914ef9-b8db-40e3-a5cf-4cccce63ea15 to /dev/vdb
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:40 user nova-compute[75051]: WARNING nova.compute.manager [req-d9848c3c-ed74-4661-a993-bdfa1f572b4b req-1020fb30-6b60-4c6d-aee7-7e90326a6b75 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state building and task_state spawning.
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.utils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8a10f-e758-4826-83a5-2570075b1fa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[185390f2-0b09-4634-9536-ffa08a6698f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d01c9d-1c6a-4064-a49a-377aed2dd789]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01c9f4e-176b-4aae-aefd-41bb5cd9fb79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:00:40 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.compute.manager [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Took 6.77 seconds to build instance.
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d38dc-8daa-4303-97ac-fe0799d021db]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG os_brick.utils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating existing volume attachment record: fe170741-5fce-47b1-a892-53546b6c786a {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:00:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-aaabb7c5-69e7-4a18-8e0c-65df12fc0a61 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:00:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:00:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Creating image(s)
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "/opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "/opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.policy [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd38ec62f093e46bc92c48a2194e69ab6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d8b0e6ade24b3bb09c0860de12e31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.218s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk 1073741824" returned: 0 in 0.054s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:41 user nova-compute[75051]: INFO nova.compute.manager [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Terminating instance
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Successfully created port: c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Cannot resize image /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:00:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Ensure instance console log exists: /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3125b9f3-c96c-459f-8064-e5874d56b24a is timed out.
Nov 24 19:00:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully detached device vdb from instance 3125b9f3-c96c-459f-8064-e5874d56b24a from the live domain config.
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVowLiaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:42 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90f9102-df09-469c-9293-973088e86e35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:00:42 user nova-compute[75051]: No targets found.
Nov 24 19:00:42 user nova-compute[75051]: iSNS:
Nov 24 19:00:42 user nova-compute[75051]: No targets found.
Nov 24 19:00:42 user nova-compute[75051]: STATIC:
Nov 24 19:00:42 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:00:42 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:42 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:42 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a
Nov 24 19:00:42 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:42 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:42 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 19:00:42 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:42 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:42 user nova-compute[75051]: FIRMWARE:
Nov 24 19:00:42 user nova-compute[75051]: No targets found.
Nov 24 19:00:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:00:42 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:00:42 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d52e2-6839-447b-a968-1439a9e82eff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f8d3e-ee01-4621-a5d4-92aad5e8e2c5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:42 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:42 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:42 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:42 user nova-compute[75051]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a (non-flash)
Nov 24 19:00:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0383130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a'): ({'sdf'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Removing single pathed devices sdf {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a7e4a3-e384-4e10-a143-959b1bc3385a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-unplugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] No waiting events found dispatching network-vif-unplugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-e0f248eb-d73b-4167-a5af-c0f77f92c35e req-f807e6ff-f3f4-4c00-a056-7f7d38aaa20e service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-unplugged-8b698032-90a7-43a0-a9d5-db06e459c47c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e01d648-2cbe-488a-a68e-9f515d85a7b0]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Flushing IO for device /dev/sdf {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[00261b1d-1bb1-4d24-9aff-44bcb5944f4a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee57555-ab8e-47d9-868c-2342b07151ae]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] SCSI volumes sdf have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e312b-00c7-43a8-9660-4c35ecf3ba21]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Instance destroyed successfully.
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lazy-loading 'resources' on Instance uuid b1887a71-7d14-4889-a12d-28f3f2959e6a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894643609',display_name='tempest-ServersNegativeTestJSON-server-1894643609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894643609',id=21,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:58:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-rnmzt9j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:58Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=b1887a71-7d14-4889-a12d-28f3f2959e6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "8b698032-90a7-43a0-a9d5-db06e459c47c", "address": "fa:16:3e:53:b0:5c", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b698032-90", "ovs_interfaceid": "8b698032-90a7-43a0-a9d5-db06e459c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_vif [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b698032-90, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53b63313-1318-4abc-a86b-fb527f2c382e) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:42 user nova-compute[75051]: INFO os_vif [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b0:5c,bridge_name='br-int',has_traffic_filtering=True,id=8b698032-90a7-43a0-a9d5-db06e459c47c,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b698032-90')
Nov 24 19:00:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Deleting instance files /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a_del
Nov 24 19:00:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Deletion of /opt/stack/data/nova/instances/b1887a71-7d14-4889-a12d-28f3f2959e6a_del complete
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b0af30-0650-4988-add4-585eff56bdab]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260]
Nov 24 19:00:42 user nova-compute[75051]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a, portal: 172.16.0.220,3260] successful.
Nov 24 19:00:42 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69bde8-b9b4-41bd-9b29-ecb4666e0f47]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== disconnect_volume: return (402ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:00:42 user nova-compute[75051]: INFO nova.compute.manager [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 24 19:00:42 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:00:42 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Successfully updated port: c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquired lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:43 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Took 0.54 seconds to deallocate network for instance.
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-89759fd5-9c63-484d-8025-1dcfcb6704fc req-b9d3680c-9319-4450-a02e-ae2756462768 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-deleted-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Updating instance_info_cache with network_info: [{"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Releasing lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Instance network_info: |[{"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Start _get_guest_xml network_info=[{"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:00:43 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:43 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-562076743',display_name='tempest-VolumesAdminNegativeTest-server-562076743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-562076743',id=23,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-602oeh0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:00:41Z,user_data=None,user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=1d84d61c-7230-4ec8-9349-b6550880fbbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d84d61c-7230-4ec8-9349-b6550880fbbc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:00:43 user nova-compute[75051]:   <uuid>1d84d61c-7230-4ec8-9349-b6550880fbbc</uuid>
Nov 24 19:00:43 user nova-compute[75051]:   <name>instance-00000017</name>
Nov 24 19:00:43 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:00:43 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:00:43 user nova-compute[75051]:   <metadata>
Nov 24 19:00:43 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:00:43 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:name>tempest-VolumesAdminNegativeTest-server-562076743</nova:name>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:00:43</nova:creationTime>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:00:43 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:00:43 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:owner>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:user uuid="d38ec62f093e46bc92c48a2194e69ab6">tempest-VolumesAdminNegativeTest-659921402-project-member</nova:user>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:project uuid="b1d8b0e6ade24b3bb09c0860de12e31c">tempest-VolumesAdminNegativeTest-659921402</nova:project>
Nov 24 19:00:43 user nova-compute[75051]:       </nova:owner>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:00:43 user nova-compute[75051]:       <nova:ports>
Nov 24 19:00:43 user nova-compute[75051]:         <nova:port uuid="c824dedb-0eda-42c4-a5e0-a3aa7fdb9015">
Nov 24 19:00:43 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 19:00:43 user nova-compute[75051]:         </nova:port>
Nov 24 19:00:43 user nova-compute[75051]:       </nova:ports>
Nov 24 19:00:43 user nova-compute[75051]:     </nova:instance>
Nov 24 19:00:43 user nova-compute[75051]:   </metadata>
Nov 24 19:00:43 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:00:43 user nova-compute[75051]:     <system>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="serial">1d84d61c-7230-4ec8-9349-b6550880fbbc</entry>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="uuid">1d84d61c-7230-4ec8-9349-b6550880fbbc</entry>
Nov 24 19:00:43 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:00:43 user nova-compute[75051]:     </system>
Nov 24 19:00:43 user nova-compute[75051]:   </sysinfo>
Nov 24 19:00:43 user nova-compute[75051]:   <os>
Nov 24 19:00:43 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:00:43 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:00:43 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:00:43 user nova-compute[75051]:   </os>
Nov 24 19:00:43 user nova-compute[75051]:   <features>
Nov 24 19:00:43 user nova-compute[75051]:     <acpi/>
Nov 24 19:00:43 user nova-compute[75051]:     <apic/>
Nov 24 19:00:43 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:00:43 user nova-compute[75051]:   </features>
Nov 24 19:00:43 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:00:43 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:00:43 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:00:43 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:00:43 user nova-compute[75051]:   </clock>
Nov 24 19:00:43 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:00:43 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:00:43 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:00:43 user nova-compute[75051]:   </cpu>
Nov 24 19:00:43 user nova-compute[75051]:   <devices>
Nov 24 19:00:43 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:00:43 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:00:43 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk"/>
Nov 24 19:00:43 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:00:43 user nova-compute[75051]:     </disk>
Nov 24 19:00:43 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:00:43 user nova-compute[75051]:       <mac address="fa:16:3e:fe:a5:0e"/>
Nov 24 19:00:43 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:00:43 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:00:43 user nova-compute[75051]:       <target dev="tapc824dedb-0e"/>
Nov 24 19:00:43 user nova-compute[75051]:     </interface>
Nov 24 19:00:43 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:00:43 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/console.log" append="off"/>
Nov 24 19:00:43 user nova-compute[75051]:     </serial>
Nov 24 19:00:43 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:00:43 user nova-compute[75051]:     <video>
Nov 24 19:00:43 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:00:43 user nova-compute[75051]:     </video>
Nov 24 19:00:43 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:00:43 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:00:43 user nova-compute[75051]:     </rng>
Nov 24 19:00:43 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:00:43 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:00:43 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:00:43 user nova-compute[75051]:     </memballoon>
Nov 24 19:00:43 user nova-compute[75051]:   </devices>
Nov 24 19:00:43 user nova-compute[75051]: </domain>
Nov 24 19:00:43 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-562076743',display_name='tempest-VolumesAdminNegativeTest-server-562076743',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-562076743',id=23,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-602oeh0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:00:41Z,user_data=None,user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=1d84d61c-7230-4ec8-9349-b6550880fbbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG os_vif [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d2dd22f-c472-5eb0-8e8c-232e978270bd', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc824dedb-0e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc824dedb-0e, col_values=(('qos', UUID('9d80aaba-b0c9-4685-91b2-acd9fe7581b0')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc824dedb-0e, col_values=(('external_ids', {'iface-id': 'c824dedb-0eda-42c4-a5e0-a3aa7fdb9015', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a5:0e', 'vm-uuid': '1d84d61c-7230-4ec8-9349-b6550880fbbc'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:43 user nova-compute[75051]: INFO os_vif [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e')
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] No VIF found with MAC fa:16:3e:fe:a5:0e, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:43 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Deleted allocations for instance b1887a71-7d14-4889-a12d-28f3f2959e6a
Nov 24 19:00:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-986743dc-5b64-44f7-9d6e-ec2132adabd5 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Acquiring lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Lock "b1887a71-7d14-4889-a12d-28f3f2959e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] No waiting events found dispatching network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:44 user nova-compute[75051]: WARNING nova.compute.manager [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: b1887a71-7d14-4889-a12d-28f3f2959e6a] Received unexpected event network-vif-plugged-8b698032-90a7-43a0-a9d5-db06e459c47c for instance with vm_state deleted and task_state None.
Nov 24 19:00:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-changed-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Refreshing instance network info cache due to event network-changed-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Acquiring lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Acquired lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:00:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Refreshing network info cache for port c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Updated VIF entry in instance network info cache for port c824dedb-0eda-42c4-a5e0-a3aa7fdb9015. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Updating instance_info_cache with network_info: [{"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3cf2d030-d7e8-4d20-ad5f-b75cbc468f80 req-f71864c6-d0f1-4d5a-8d6d-a568b60271c5 service nova] Releasing lock "refresh_cache-1d84d61c-7230-4ec8-9349-b6550880fbbc" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:45 user nova-compute[75051]: WARNING nova.compute.manager [req-6408c3e6-69f4-4bd4-80ae-622e74350139 req-b18872c1-18f0-4d34-9450-9222556c085e service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state building and task_state spawning.
Nov 24 19:00:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:00:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Instance spawned successfully.
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:47 user nova-compute[75051]: WARNING nova.compute.manager [req-084e966a-dd3b-43df-bb1c-818a3187de1c req-1c7f2b32-61b8-423d-8e62-287ac8041b11 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state building and task_state spawning.
Nov 24 19:00:47 user nova-compute[75051]: INFO nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 24 19:00:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:00:47 user nova-compute[75051]: INFO nova.compute.manager [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Took 7.32 seconds to build instance.
Nov 24 19:00:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1663c0e6-b5be-423b-9310-4aef96ccc518 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.423s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'flavor' on Instance uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-97e976ed-b886-4e72-a4a3-52d5663abdf8 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.529s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 26.406s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:48 user nova-compute[75051]: INFO nova.compute.manager [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Terminating instance
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-unplugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] No waiting events found dispatching network-vif-unplugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-d89876e4-8a42-49c3-97bb-4f5bc9111c1c req-69c69822-2fa6-4b26-95ff-f75e56419765 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-unplugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tALFazio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:48 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:48 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:48 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:00:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf1ab4c-ae29-46af-a495-dcc92afd371a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:00:48 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099ab2d-eb6c-4243-bc23-e1a9fab05057]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15] added
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f6b1c6-7c57-4b4e-af70-b6d53181e3d9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4baa2-1e7b-4f07-8318-3262058ad9f5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tALFazio {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tALFazio" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba7bba-08a6-4589-90d0-b831d600438e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tALFazio'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9576cb76-2ebd-40fb-8ba6-02fb02cf911f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f9ad0f-9a20-4844-90f9-906e6869d28e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c572258-491c-4f8f-8aca-612d6844ab88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260]
Nov 24 19:00:48 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260] successful.
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[992cf554-5c4a-4fde-973e-3a672647acd8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[441987df-16fa-479e-b717-5cda9936c359]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:48 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:00:48 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3993836-8680-40dc-b26d-27a3c5f529ac]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:48 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:00:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Instance destroyed successfully.
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lazy-loading 'resources' on Instance uuid 3125b9f3-c96c-459f-8064-e5874d56b24a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:58:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1007041992',display_name='tempest-VolumesSnapshotTestJSON-instance-1007041992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1007041992',id=20,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxqx9Eswi9QNiWDX71z3AKsYRlvGkeQDRu4A6utESLvsYaKT+8GmJNBZrp5a716eopwbfleM+IX9YSHUTiPOzTMPVhR+a4fWfe8BAkfMzEcaDSQ4SFg35dp8JP4WnuNiQ==',key_name='tempest-keypair-1123335759',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2ae522b213c4592acb5df152b4266a0',ramdisk_id='',reservation_id='r-zypiafpe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332746489',owner_user_name='tempest-VolumesSnapshotTestJSON-1332746489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c14d0f83b34441f998e48bf56844dec8',uuid=3125b9f3-c96c-459f-8064-e5874d56b24a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converting VIF {"id": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "address": "fa:16:3e:94:e7:f9", "network": {"id": "b4b9bbcc-a722-4462-8d62-f6cb6550abba", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1965260745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2ae522b213c4592acb5df152b4266a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a7c97d1-68", "ovs_interfaceid": "8a7c97d1-68a3-4b7f-999b-bb8e20772712", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_vif [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a7c97d1-68, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec49838c-7e2b-454d-ae10-e54b53e4971b) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:49 user nova-compute[75051]: INFO os_vif [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e7:f9,bridge_name='br-int',has_traffic_filtering=True,id=8a7c97d1-68a3-4b7f-999b-bb8e20772712,network=Network(b4b9bbcc-a722-4462-8d62-f6cb6550abba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a7c97d1-68')
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BVowLiaZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:00:49 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tALFazio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23337306234623061', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337306234623061', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.842s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fec2055-95d4-4e26-9954-0216fe493320]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:00:49 user nova-compute[75051]: No targets found.
Nov 24 19:00:49 user nova-compute[75051]: iSNS:
Nov 24 19:00:49 user nova-compute[75051]: No targets found.
Nov 24 19:00:49 user nova-compute[75051]: STATIC:
Nov 24 19:00:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:00:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15
Nov 24 19:00:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 19:00:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:00:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:00:49 user nova-compute[75051]: FIRMWARE:
Nov 24 19:00:49 user nova-compute[75051]: No targets found.
Nov 24 19:00:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:00:49 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:00:49 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71927b99-fe8a-4deb-9b21-4352ec18872a', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:00:49 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:49 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:00:49 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:49 user nova-compute[75051]:   <serial>ce914ef9-b8db-40e3-a5cf-4cccce63ea15</serial>
Nov 24 19:00:49 user nova-compute[75051]: </disk>
Nov 24 19:00:49 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5cd16-3267-4b64-a44a-d249b5afd4e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ba758b-42cd-491b-aba7-49f400c78ccd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:49 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:49 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:00:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:00:49 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:00:49 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:00:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c023ba30>, {}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Disconnecting from: [] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] <== disconnect_volume: return (914ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:00:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:00:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Deleting instance files /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a_del
Nov 24 19:00:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Deletion of /opt/stack/data/nova/instances/3125b9f3-c96c-459f-8064-e5874d56b24a_del complete
Nov 24 19:00:50 user nova-compute[75051]: INFO nova.compute.manager [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Took 1.85 seconds to destroy the instance on the hypervisor.
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No VIF found with MAC fa:16:3e:93:f0:e2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2783bb31-bb12-47e4-95f6-58c46c279393 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.772s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] Acquiring lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] No waiting events found dispatching network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:00:50 user nova-compute[75051]: WARNING nova.compute.manager [req-9a8ed977-b239-4cf0-ac1a-ee42c785cbc1 req-32efc5a7-ea4a-4f8c-818d-f5b2fb7ffc51 service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received unexpected event network-vif-plugged-8a7c97d1-68a3-4b7f-999b-bb8e20772712 for instance with vm_state active and task_state deleting.
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:00:50 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Took 0.83 seconds to deallocate network for instance.
Nov 24 19:00:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-73ca947d-0e49-4067-8726-ef7d69f30e1a req-6fa70740-07c2-4af1-aab9-ba049a0b5f6b service nova] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Received event network-vif-deleted-8a7c97d1-68a3-4b7f-999b-bb8e20772712 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:00:50 user nova-compute[75051]: WARNING nova.volume.cinder [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Attachment 62ed0455-ce5c-4c2f-8b0f-f42cf123534b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 62ed0455-ce5c-4c2f-8b0f-f42cf123534b. (HTTP 404) (Request-ID: req-fd81f31b-55bc-4ef1-82e1-422b9e2dac60)
Nov 24 19:00:50 user nova-compute[75051]: INFO nova.compute.manager [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] [instance: 3125b9f3-c96c-459f-8064-e5874d56b24a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:00:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:00:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:51 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Deleted allocations for instance 3125b9f3-c96c-459f-8064-e5874d56b24a
Nov 24 19:00:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-129e6fae-319f-4706-8749-604ddc41a1d0 tempest-VolumesSnapshotTestJSON-1332746489 tempest-VolumesSnapshotTestJSON-1332746489-project-member] Lock "3125b9f3-c96c-459f-8064-e5874d56b24a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.448s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:00:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:00:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:00:52 user nova-compute[75051]: INFO nova.compute.manager [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Detaching volume ce914ef9-b8db-40e3-a5cf-4cccce63ea15
Nov 24 19:00:52 user nova-compute[75051]: INFO nova.virt.block_device [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attempting to driver detach volume ce914ef9-b8db-40e3-a5cf-4cccce63ea15 from mountpoint /dev/vdb
Nov 24 19:00:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Attempting to detach device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:00:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:00:52 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:52 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:00:52 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:52 user nova-compute[75051]:   <serial>ce914ef9-b8db-40e3-a5cf-4cccce63ea15</serial>
Nov 24 19:00:52 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:00:52 user nova-compute[75051]: </disk>
Nov 24 19:00:52 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:00:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config.
Nov 24 19:00:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:00:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:00:52 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:00:52 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:00:52 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:00:52 user nova-compute[75051]:   <serial>ce914ef9-b8db-40e3-a5cf-4cccce63ea15</serial>
Nov 24 19:00:52 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:00:52 user nova-compute[75051]: </disk>
Nov 24 19:00:52 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:00:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:00:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:00:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:00 user nova-compute[75051]: INFO nova.compute.manager [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Terminating instance
Nov 24 19:01:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:01:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-acd9455d-d891-4671-b36e-105228a24de2 req-348a408c-f25e-4481-9b84-8aef376c7782 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-unplugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:01:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Instance destroyed successfully.
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lazy-loading 'resources' on Instance uuid 451ff98d-318a-4a05-a612-e3ce527d1164 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1162642123',display_name='tempest-ServerActionsTestOtherB-server-1162642123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1162642123',id=3,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzfGGXxecE65ktHO9Ngt/DVwRvsHDRXh9wX/Pd7mNLkMlBUbhgBif/fIILrPJjgVdAyXQcmc5GMgSyQVPXrBgX77bhqpiQJiX5GybYJKeI2cwmp7H+WJLulAfEFWViThw==',key_name='tempest-keypair-1473746655',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:58:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='233bc8e889de4ee8b6a00050bee74931',ramdisk_id='',reservation_id='r-25nlspci',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-355305494',owner_user_name='tempest-ServerActionsTestOtherB-355305494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:58:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e4cb3329e664cf2b3452e4107df7060',uuid=451ff98d-318a-4a05-a612-e3ce527d1164,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converting VIF {"id": "3477becc-b128-4274-84c5-37633e88d5eb", "address": "fa:16:3e:84:5f:4d", "network": {"id": "5de2c70c-b1e3-452f-95f4-0b46d8067da2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-601829907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "233bc8e889de4ee8b6a00050bee74931", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3477becc-b1", "ovs_interfaceid": "3477becc-b128-4274-84c5-37633e88d5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_vif [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3477becc-b1, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9248f2b3-f69d-4592-b4de-d6f0e0d39e7e) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:01 user nova-compute[75051]: INFO os_vif [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:5f:4d,bridge_name='br-int',has_traffic_filtering=True,id=3477becc-b128-4274-84c5-37633e88d5eb,network=Network(5de2c70c-b1e3-452f-95f4-0b46d8067da2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3477becc-b1')
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cKhJRxIo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:01:01 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edae671-be77-4e1c-9e6c-7ce996189c7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:01:01 user nova-compute[75051]: No targets found.
Nov 24 19:01:01 user nova-compute[75051]: iSNS:
Nov 24 19:01:01 user nova-compute[75051]: No targets found.
Nov 24 19:01:01 user nova-compute[75051]: STATIC:
Nov 24 19:01:01 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:01:01 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:01:01 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:01:01 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15
Nov 24 19:01:01 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:01:01 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:01:01 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac
Nov 24 19:01:01 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:01:01 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:01:01 user nova-compute[75051]: FIRMWARE:
Nov 24 19:01:01 user nova-compute[75051]: No targets found.
Nov 24 19:01:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:01:01 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:01:01 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08efc86-1097-489e-bdbf-51f296978209]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae2ebf4-4076-4ee2-a4c3-5feb88f87d08]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:01 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:01:01 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:01:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:01 user nova-compute[75051]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac (non-flash)
Nov 24 19:01:01 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:01:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0435ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8b17e-e336-4aad-a6aa-229b48954e89]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[608731fc-6439-41b2-a74e-443514154bca]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770a8a4-e3c4-4370-ba66-51490b4cdec2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c80f44-236e-4e27-bd50-9b9f560d7034]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b522b06-dccf-4b1c-9805-7f926f39f7b1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9402634-e493-40fc-aa50-91671f02d2ba]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260]
Nov 24 19:01:01 user nova-compute[75051]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac, portal: 172.16.0.220,3260] successful.
Nov 24 19:01:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1adcd3-b055-4d6f-b9c9-6a42c5aa29ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b261373-6f13-41bd-9658-a8ef689e7e95]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] <== disconnect_volume: return (361ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:01:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Deleting instance files /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_del
Nov 24 19:01:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Deletion of /opt/stack/data/nova/instances/451ff98d-318a-4a05-a612-e3ce527d1164_del complete
Nov 24 19:01:01 user nova-compute[75051]: INFO nova.compute.manager [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 24 19:01:01 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:01:01 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:01:02 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Took 0.66 seconds to deallocate network for instance.
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-cfc8fc5a-55cf-493f-9d52-df0810dbfe8a req-72943c25-f194-4a09-992f-4fa575bcef4f service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-deleted-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:02 user nova-compute[75051]: INFO nova.compute.manager [req-cfc8fc5a-55cf-493f-9d52-df0810dbfe8a req-72943c25-f194-4a09-992f-4fa575bcef4f service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Neutron deleted interface 3477becc-b128-4274-84c5-37633e88d5eb; detaching it from the instance and deleting it from the info cache
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-cfc8fc5a-55cf-493f-9d52-df0810dbfe8a req-72943c25-f194-4a09-992f-4fa575bcef4f service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-cfc8fc5a-55cf-493f-9d52-df0810dbfe8a req-72943c25-f194-4a09-992f-4fa575bcef4f service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Detach interface failed, port_id=3477becc-b128-4274-84c5-37633e88d5eb, reason: Instance 451ff98d-318a-4a05-a612-e3ce527d1164 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] Acquiring lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] Lock "451ff98d-318a-4a05-a612-e3ce527d1164-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] No waiting events found dispatching network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:01:02 user nova-compute[75051]: WARNING nova.compute.manager [req-5dec8e75-8ed3-4a10-8968-766ab8b0cb91 req-9a15c373-1e13-4689-9370-55a2cbad2ef8 service nova] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Received unexpected event network-vif-plugged-3477becc-b128-4274-84c5-37633e88d5eb for instance with vm_state active and task_state deleting.
Nov 24 19:01:03 user nova-compute[75051]: INFO nova.compute.manager [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] [instance: 451ff98d-318a-4a05-a612-e3ce527d1164] Took 0.89 seconds to detach 1 volumes for instance.
Nov 24 19:01:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:03 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:01:03 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:01:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:03 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Deleted allocations for instance 451ff98d-318a-4a05-a612-e3ce527d1164
Nov 24 19:01:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-16068592-b282-4fba-a180-43ed6f83f58e tempest-ServerActionsTestOtherB-355305494 tempest-ServerActionsTestOtherB-355305494-project-member] Lock "451ff98d-318a-4a05-a612-e3ce527d1164" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.524s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:11 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 is timed out.
Nov 24 19:01:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config.
Nov 24 19:01:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tALFazio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:01:13 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adc0531-438e-4d06-ae43-0e58a185ce4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:01:13 user nova-compute[75051]: No targets found.
Nov 24 19:01:13 user nova-compute[75051]: iSNS:
Nov 24 19:01:13 user nova-compute[75051]: No targets found.
Nov 24 19:01:13 user nova-compute[75051]: STATIC:
Nov 24 19:01:13 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:01:13 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:01:13 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:01:13 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15
Nov 24 19:01:13 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:01:13 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:01:13 user nova-compute[75051]: FIRMWARE:
Nov 24 19:01:13 user nova-compute[75051]: No targets found.
Nov 24 19:01:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:01:13 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:01:13 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c0a971-bb8c-4e7b-b031-fba7d299b212]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50548e25-d17c-46bc-afc1-197962bcec9f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:13 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:01:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:13 user nova-compute[75051]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 (non-flash)
Nov 24 19:01:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c023bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c543991b-b076-408f-b644-699130820c3a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff9e169-bb68-4360-b4a3-eff84d9f39fa]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986ed2d-7224-44fa-8fcd-9e5e8e5a0920]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f8add-4fae-43d9-a533-cb10bb5a2c46]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a433b22-d8b6-46db-a2c1-9ead2c0b2fde]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24665c-8c97-45a8-b8c4-e85bec9e6620]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260]
Nov 24 19:01:13 user nova-compute[75051]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15, portal: 172.16.0.220,3260] successful.
Nov 24 19:01:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce914ef9-b8db-40e3-a5cf-4cccce63ea15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc4d0e-b8d2-4550-af67-4c79ad53f742]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== disconnect_volume: return (380ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2b52e09c-874b-4d68-ad21-205c92d6201e tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.007s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:15 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:01:15 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.36587905883789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1d84d61c-7230-4ec8-9349-b6550880fbbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:01:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:01:17 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:01:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:01:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:01:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:01:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:01:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:01:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:01:42 user nova-compute[75051]: INFO nova.compute.claims [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Claim successful on node user
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:01:43 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.policy [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88113529ca6747f281d4203c9c1d845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae7be1d57e44aae8c9b5695bba53ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:01:43 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Creating image(s)
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "/opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk 1073741824" returned: 0 in 0.054s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Successfully created port: 29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Cannot resize image /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Ensure instance console log exists: /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Successfully updated port: 29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-changed-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Refreshing instance network info cache due to event network-changed-29e89e8a-255b-417f-8481-dccc7495cf06. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] Acquiring lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:44 user nova-compute[75051]: INFO nova.compute.manager [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attaching volume 0736ff91-4bf8-44c9-b997-8a539c985f7f to /dev/vdb
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.utils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0f95b-a6b5-4a12-9a45-9dbb6abbc27f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[464d647f-58b0-4c33-b88d-934fc40a462f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fbf4a9-c10c-4b4e-8a4a-1ed0ba746902]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0ac1a-0ab7-4e4f-97ce-56d7f1d37b71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:01:45 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fc8358-2ed3-4dcd-86f8-a68ff2e3b626]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_brick.utils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating existing volume attachment record: 0c774827-aada-4bcc-969e-b29dd10a9f99 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.neutron [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updating instance_info_cache with network_info: [{"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Instance network_info: |[{"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] Acquired lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Refreshing network info cache for port 29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Start _get_guest_xml network_info=[{"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:01:45 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:01:45 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-113712468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-113712468',id=24,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-kqndix34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:01:43Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:01:45 user nova-compute[75051]:   <uuid>e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353</uuid>
Nov 24 19:01:45 user nova-compute[75051]:   <name>instance-00000018</name>
Nov 24 19:01:45 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:01:45 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:01:45 user nova-compute[75051]:   <metadata>
Nov 24 19:01:45 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:01:45 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-113712468</nova:name>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:01:45</nova:creationTime>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:01:45 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:01:45 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:owner>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 19:01:45 user nova-compute[75051]:       </nova:owner>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:01:45 user nova-compute[75051]:       <nova:ports>
Nov 24 19:01:45 user nova-compute[75051]:         <nova:port uuid="29e89e8a-255b-417f-8481-dccc7495cf06">
Nov 24 19:01:45 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 24 19:01:45 user nova-compute[75051]:         </nova:port>
Nov 24 19:01:45 user nova-compute[75051]:       </nova:ports>
Nov 24 19:01:45 user nova-compute[75051]:     </nova:instance>
Nov 24 19:01:45 user nova-compute[75051]:   </metadata>
Nov 24 19:01:45 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:01:45 user nova-compute[75051]:     <system>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="serial">e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353</entry>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="uuid">e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353</entry>
Nov 24 19:01:45 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:01:45 user nova-compute[75051]:     </system>
Nov 24 19:01:45 user nova-compute[75051]:   </sysinfo>
Nov 24 19:01:45 user nova-compute[75051]:   <os>
Nov 24 19:01:45 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:01:45 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:01:45 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:01:45 user nova-compute[75051]:   </os>
Nov 24 19:01:45 user nova-compute[75051]:   <features>
Nov 24 19:01:45 user nova-compute[75051]:     <acpi/>
Nov 24 19:01:45 user nova-compute[75051]:     <apic/>
Nov 24 19:01:45 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:01:45 user nova-compute[75051]:   </features>
Nov 24 19:01:45 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:01:45 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:01:45 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:01:45 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:01:45 user nova-compute[75051]:   </clock>
Nov 24 19:01:45 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:01:45 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:01:45 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:01:45 user nova-compute[75051]:   </cpu>
Nov 24 19:01:45 user nova-compute[75051]:   <devices>
Nov 24 19:01:45 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:01:45 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:01:45 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk"/>
Nov 24 19:01:45 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:01:45 user nova-compute[75051]:     </disk>
Nov 24 19:01:45 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:01:45 user nova-compute[75051]:       <mac address="fa:16:3e:02:86:58"/>
Nov 24 19:01:45 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:01:45 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:01:45 user nova-compute[75051]:       <target dev="tap29e89e8a-25"/>
Nov 24 19:01:45 user nova-compute[75051]:     </interface>
Nov 24 19:01:45 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:01:45 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/console.log" append="off"/>
Nov 24 19:01:45 user nova-compute[75051]:     </serial>
Nov 24 19:01:45 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:01:45 user nova-compute[75051]:     <video>
Nov 24 19:01:45 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:01:45 user nova-compute[75051]:     </video>
Nov 24 19:01:45 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:01:45 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:01:45 user nova-compute[75051]:     </rng>
Nov 24 19:01:45 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:01:45 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:01:45 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:01:45 user nova-compute[75051]:     </memballoon>
Nov 24 19:01:45 user nova-compute[75051]:   </devices>
Nov 24 19:01:45 user nova-compute[75051]: </domain>
Nov 24 19:01:45 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-113712468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-113712468',id=24,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-kqndix34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:01:43Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG os_vif [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6550e387-51a4-58d7-8034-6727d600a3c8', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29e89e8a-25, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29e89e8a-25, col_values=(('qos', UUID('709aafbb-7c3f-49d0-a580-6c344145e3c1')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29e89e8a-25, col_values=(('external_ids', {'iface-id': '29e89e8a-255b-417f-8481-dccc7495cf06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:86:58', 'vm-uuid': 'e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:45 user nova-compute[75051]: INFO os_vif [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25')
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:01:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:02:86:58, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updated VIF entry in instance network info cache for port 29e89e8a-255b-417f-8481-dccc7495cf06. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updating instance_info_cache with network_info: [{"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-187c862f-31a3-41cc-a9e7-d1c4887aaae4 req-43315000-170d-4172-abe1-d80a34d5cf51 service nova] Releasing lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] No waiting events found dispatching network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:01:46 user nova-compute[75051]: WARNING nova.compute.manager [req-d39af332-7552-4cac-9751-2a54ba73dd22 req-2f0355f7-a961-4b25-a3bd-79d08af8bb0b service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received unexpected event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 for instance with vm_state building and task_state spawning.
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:01:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Instance spawned successfully.
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:01:48 user nova-compute[75051]: INFO nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] No waiting events found dispatching network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:01:48 user nova-compute[75051]: WARNING nova.compute.manager [req-37cbd380-4468-4ac3-9bee-3832dff4ddee req-76e040bc-cd87-4aec-9ece-df97b89af846 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received unexpected event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 for instance with vm_state building and task_state spawning.
Nov 24 19:01:49 user nova-compute[75051]: INFO nova.compute.manager [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Took 6.25 seconds to build instance.
Nov 24 19:01:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-541b79aa-4d15-4249-a41a-d28375d1c463 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.345s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:01:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLCgSBst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:01:58 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:01:58 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:01:58 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3db9ec2-32c6-4c03-b661-bdfdb98978b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:01:58 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc3c13-d601-4449-9ba2-ab7ca8467304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f] added
Nov 24 19:01:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[981045aa-fed4-4bf0-9eb1-28ebc4f833b0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ce3e8-7dfb-4dfa-83d3-e18ca985134a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLCgSBst {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FLCgSBst" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56000e99-98b4-4983-9f46-41b75a1935bc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FLCgSBst'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aacfa7-2367-45ea-90bc-28c91de44d58]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f565145-0ccb-4ae6-8dfd-4d274b0ba566]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f9ec6-2b50-4181-9806-dc2938a4f07a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260]
Nov 24 19:01:58 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260] successful.
Nov 24 19:01:58 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db3903-c635-4d09-9267-8a3e3bb6e66f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:01:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a464f-6447-42e5-b53a-dc384a07d7c7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:59 user nova-compute[75051]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)
Nov 24 19:01:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:01:59 user nova-compute[75051]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)
Nov 24 19:01:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f4b444-8f39-4934-bc35-aa9c2af9623e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:01:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLCgSBst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26362333936666233', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362333936666233', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:02:00 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:00 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:02:00 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:02:00 user nova-compute[75051]:   <serial>0736ff91-4bf8-44c9-b997-8a539c985f7f</serial>
Nov 24 19:02:00 user nova-compute[75051]: </disk>
Nov 24 19:02:00 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No VIF found with MAC fa:16:3e:93:f0:e2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:02:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5a7e900f-b872-44eb-9742-c37df724d557 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.771s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:03 user nova-compute[75051]: INFO nova.compute.manager [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Detaching volume 0736ff91-4bf8-44c9-b997-8a539c985f7f
Nov 24 19:02:03 user nova-compute[75051]: INFO nova.virt.block_device [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attempting to driver detach volume 0736ff91-4bf8-44c9-b997-8a539c985f7f from mountpoint /dev/vdb
Nov 24 19:02:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Attempting to detach device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:02:03 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:03 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:02:03 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:02:03 user nova-compute[75051]:   <serial>0736ff91-4bf8-44c9-b997-8a539c985f7f</serial>
Nov 24 19:02:03 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:02:03 user nova-compute[75051]: </disk>
Nov 24 19:02:03 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:02:03 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config.
Nov 24 19:02:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:02:03 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:03 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:02:03 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:02:03 user nova-compute[75051]:   <serial>0736ff91-4bf8-44c9-b997-8a539c985f7f</serial>
Nov 24 19:02:03 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:02:03 user nova-compute[75051]: </disk>
Nov 24 19:02:03 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:02:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:02:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:12 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:02:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:02:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7860MB free_disk=25.322784423828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1d84d61c-7230-4ec8-9349-b6550880fbbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:02:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:02:18 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updating instance_info_cache with network_info: [{"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-9ed867b7-145b-4050-8633-2d6a18689a2a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:02:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:02:21 user nova-compute[75051]: INFO nova.compute.claims [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Claim successful on node user
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:02:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.policy [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd837fbd543a9418d9c4e130bd2250a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8060f2b760f4074b5a6827102cdb518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:02:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Creating image(s)
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "/opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "/opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.230s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk 1073741824" returned: 0 in 0.053s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Successfully created port: db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Cannot resize image /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Ensure instance console log exists: /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 is timed out.
Nov 24 19:02:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config.
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FLCgSBst', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:23 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc34e2d-4ca8-4258-8f3d-4e3b96d0eac7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:02:23 user nova-compute[75051]: No targets found.
Nov 24 19:02:23 user nova-compute[75051]: iSNS:
Nov 24 19:02:23 user nova-compute[75051]: No targets found.
Nov 24 19:02:23 user nova-compute[75051]: STATIC:
Nov 24 19:02:23 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:02:23 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:02:23 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:02:23 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f
Nov 24 19:02:23 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:02:23 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:02:23 user nova-compute[75051]: FIRMWARE:
Nov 24 19:02:23 user nova-compute[75051]: No targets found.
Nov 24 19:02:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:02:23 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:02:23 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f2ae6-13d3-4d67-bcfd-944040f839a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Successfully updated port: db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d66811-43d8-4d54-a44b-7575f7949717]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:23 user nova-compute[75051]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)
Nov 24 19:02:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:23 user nova-compute[75051]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f (non-flash)
Nov 24 19:02:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05a43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquired lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1eee8d-db7c-4afe-a4ae-877f36d6d0bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing instance network info cache due to event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] Acquiring lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cdcca4-9e44-4fec-b17e-b7db77d6e3fc]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c9f61-4f13-4e74-a9f2-cd6b6f0f8a45]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf72f63-be3f-4ec6-bb34-69a450db5331]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b69ec-6e59-47af-948d-e841cd23226b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75953630-7119-45d8-ad0c-5fccd45f41d9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260]
Nov 24 19:02:23 user nova-compute[75051]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f, portal: 172.16.0.220,3260] successful.
Nov 24 19:02:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0736ff91-4bf8-44c9-b997-8a539c985f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d9e41d-f8a8-44cd-a913-0c6fb90b7851]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== disconnect_volume: return (324ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating instance_info_cache with network_info: [{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Releasing lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Instance network_info: |[{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] Acquired lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Start _get_guest_xml network_info=[{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:02:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:02:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1460718531',display_name='tempest-TestStampPattern-server-1460718531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1460718531',id=25,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-cejhrior',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:02:22Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=0a26aa8a-384a-4bb2-9952-61724355bee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:02:24 user nova-compute[75051]:   <uuid>0a26aa8a-384a-4bb2-9952-61724355bee8</uuid>
Nov 24 19:02:24 user nova-compute[75051]:   <name>instance-00000019</name>
Nov 24 19:02:24 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:02:24 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:02:24 user nova-compute[75051]:   <metadata>
Nov 24 19:02:24 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:02:24 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:name>tempest-TestStampPattern-server-1460718531</nova:name>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:02:24</nova:creationTime>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:02:24 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:02:24 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:owner>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:user uuid="d837fbd543a9418d9c4e130bd2250a09">tempest-TestStampPattern-1820980037-project-member</nova:user>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:project uuid="a8060f2b760f4074b5a6827102cdb518">tempest-TestStampPattern-1820980037</nova:project>
Nov 24 19:02:24 user nova-compute[75051]:       </nova:owner>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:02:24 user nova-compute[75051]:       <nova:ports>
Nov 24 19:02:24 user nova-compute[75051]:         <nova:port uuid="db6ce854-31dd-4987-b595-1a5d9cbfdd1d">
Nov 24 19:02:24 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 19:02:24 user nova-compute[75051]:         </nova:port>
Nov 24 19:02:24 user nova-compute[75051]:       </nova:ports>
Nov 24 19:02:24 user nova-compute[75051]:     </nova:instance>
Nov 24 19:02:24 user nova-compute[75051]:   </metadata>
Nov 24 19:02:24 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:02:24 user nova-compute[75051]:     <system>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="serial">0a26aa8a-384a-4bb2-9952-61724355bee8</entry>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="uuid">0a26aa8a-384a-4bb2-9952-61724355bee8</entry>
Nov 24 19:02:24 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:02:24 user nova-compute[75051]:     </system>
Nov 24 19:02:24 user nova-compute[75051]:   </sysinfo>
Nov 24 19:02:24 user nova-compute[75051]:   <os>
Nov 24 19:02:24 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:02:24 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:02:24 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:02:24 user nova-compute[75051]:   </os>
Nov 24 19:02:24 user nova-compute[75051]:   <features>
Nov 24 19:02:24 user nova-compute[75051]:     <acpi/>
Nov 24 19:02:24 user nova-compute[75051]:     <apic/>
Nov 24 19:02:24 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:02:24 user nova-compute[75051]:   </features>
Nov 24 19:02:24 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:02:24 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:02:24 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:02:24 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:02:24 user nova-compute[75051]:   </clock>
Nov 24 19:02:24 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:02:24 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:02:24 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:02:24 user nova-compute[75051]:   </cpu>
Nov 24 19:02:24 user nova-compute[75051]:   <devices>
Nov 24 19:02:24 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:02:24 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:02:24 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk"/>
Nov 24 19:02:24 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:02:24 user nova-compute[75051]:     </disk>
Nov 24 19:02:24 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:02:24 user nova-compute[75051]:       <mac address="fa:16:3e:65:d0:7e"/>
Nov 24 19:02:24 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:02:24 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:02:24 user nova-compute[75051]:       <target dev="tapdb6ce854-31"/>
Nov 24 19:02:24 user nova-compute[75051]:     </interface>
Nov 24 19:02:24 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:02:24 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/console.log" append="off"/>
Nov 24 19:02:24 user nova-compute[75051]:     </serial>
Nov 24 19:02:24 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:02:24 user nova-compute[75051]:     <video>
Nov 24 19:02:24 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:02:24 user nova-compute[75051]:     </video>
Nov 24 19:02:24 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:02:24 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:02:24 user nova-compute[75051]:     </rng>
Nov 24 19:02:24 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:02:24 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:02:24 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:02:24 user nova-compute[75051]:     </memballoon>
Nov 24 19:02:24 user nova-compute[75051]:   </devices>
Nov 24 19:02:24 user nova-compute[75051]: </domain>
Nov 24 19:02:24 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1460718531',display_name='tempest-TestStampPattern-server-1460718531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1460718531',id=25,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-cejhrior',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:02:22Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=0a26aa8a-384a-4bb2-9952-61724355bee8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG os_vif [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f41922a1-14d9-5fea-a05e-8f53b2a95891', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb6ce854-31, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb6ce854-31, col_values=(('qos', UUID('82db9061-f5e1-46c3-a736-6e063b7b0ed7')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb6ce854-31, col_values=(('external_ids', {'iface-id': 'db6ce854-31dd-4987-b595-1a5d9cbfdd1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:d0:7e', 'vm-uuid': '0a26aa8a-384a-4bb2-9952-61724355bee8'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:24 user nova-compute[75051]: INFO os_vif [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31')
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No VIF found with MAC fa:16:3e:65:d0:7e, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updated VIF entry in instance network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating instance_info_cache with network_info: [{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4df7160a-43a6-49db-97dd-15df4f155312 req-53b4c80a-2e4c-402e-8cdc-eef1933c0819 service nova] Releasing lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e281c1cc-672f-414d-a871-4628725a5033 tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.181s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-changed-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Refreshing instance network info cache due to event network-changed-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] Acquiring lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] Acquired lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Refreshing network info cache for port c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updated VIF entry in instance network info cache for port c481b3ac-4641-4ab8-a878-9fb3b90ad8f0. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG nova.network.neutron [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating instance_info_cache with network_info: [{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a01100ee-8061-4154-ba84-d4475988f740 req-922315bb-7838-46ca-bd2e-5ed5c7f509f0 service nova] Releasing lock "refresh_cache-9359be0c-8d4b-4a3a-b2a6-371f108f39db" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] No waiting events found dispatching network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:26 user nova-compute[75051]: WARNING nova.compute.manager [req-732d2ddb-5642-4ab2-b610-3f3a7fc096d0 req-49c3e65a-02d2-43dd-92b1-becfea24cd36 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received unexpected event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d for instance with vm_state building and task_state spawning.
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'flavor' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:26 user nova-compute[75051]: INFO nova.compute.manager [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attaching volume b62462ba-5451-4732-80f3-cf043d5f6546 to /dev/vdb
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.utils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c5abbb-231b-46ca-838d-3fb0a326c8f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286cbce-640a-4cae-bdb3-778f538d5289]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b127529f-81a5-44db-bf62-6826567fadea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[279c830b-d391-4313-8eb7-b9cc1252ff35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:27 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:02:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[38240398-9ddb-4d73-86f7-7465ccb855d3]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG os_brick.utils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:27 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating existing volume attachment record: ea8d6361-c506-4a22-915b-8b1d7fd548a0 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:02:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Instance spawned successfully.
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] No waiting events found dispatching network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:28 user nova-compute[75051]: WARNING nova.compute.manager [req-98965f3c-c2f8-4ac1-83b9-57f317834596 req-97a23345-4fca-4066-afa9-d7d8cbca0a8d service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received unexpected event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d for instance with vm_state building and task_state spawning.
Nov 24 19:02:28 user nova-compute[75051]: INFO nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 24 19:02:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:02:28 user nova-compute[75051]: INFO nova.compute.manager [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Took 7.34 seconds to build instance.
Nov 24 19:02:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5fb4970e-e553-4ba6-9a8c-a346c9a41535 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.440s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:34 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:34 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:34 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e66f9a6-cb70-43b4-8ce6-81c6234f3ded]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:02:34 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5bbbdf-5bd7-433f-bc4c-d4141a4b7076]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546] added
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa7e12-c51a-4b09-be4d-dffa0a0bc31f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff61b18-10d3-4a5c-ac80-60a3231408fa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBtyjuOr {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBtyjuOr" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6bd263-2e04-46f3-a77e-e0f6f1ea9b14]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBtyjuOr'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8daa87d-4b94-4a6c-aec0-fe401e94a3dd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ed3d69-0b21-4727-9e3c-0b396e813da8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a64302-495d-4c60-a079-671fe2858913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]
Nov 24 19:02:34 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc73d80-9b40-4fef-a793-bdd8e76a9867]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8312025-a371-4282-abee-07033dc7f2a3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0320ee1f-d415-427e-b9d4-42ac0384e8df]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26232323965623738', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232323965623738', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'flavor' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:02:35 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:35 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:02:35 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:02:35 user nova-compute[75051]:   <serial>b62462ba-5451-4732-80f3-cf043d5f6546</serial>
Nov 24 19:02:35 user nova-compute[75051]: </disk>
Nov 24 19:02:35 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:02:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:df:67:89, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:02:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ac37bed3-af0d-469f-b66a-72385e2d590f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.309s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:37 user nova-compute[75051]: INFO nova.compute.manager [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Rebuilding instance
Nov 24 19:02:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:37 user nova-compute[75051]: INFO nova.compute.manager [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Terminating instance
Nov 24 19:02:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:38 user nova-compute[75051]: WARNING nova.compute.manager [req-8a0a5e39-651d-40d7-ae8f-f02d21356d37 req-6a47de6a-c0a7-450f-b13a-969d8713e525 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state active and task_state rebuilding.
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Instance destroyed successfully.
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.objects.instance [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'resources' on Instance uuid 1d84d61c-7230-4ec8-9349-b6550880fbbc {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-562076743',display_name='tempest-VolumesAdminNegativeTest-server-562076743',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-562076743',id=23,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-602oeh0h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:00:48Z,user_data=None,user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=1d84d61c-7230-4ec8-9349-b6550880fbbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "address": "fa:16:3e:fe:a5:0e", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc824dedb-0e", "ovs_interfaceid": "c824dedb-0eda-42c4-a5e0-a3aa7fdb9015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG os_vif [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc824dedb-0e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance destroyed successfully.
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d80aaba-b0c9-4685-91b2-acd9fe7581b0) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: INFO os_vif [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:0e,bridge_name='br-int',has_traffic_filtering=True,id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc824dedb-0e')
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Deleting instance files /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc_del
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Deletion of /opt/stack/data/nova/instances/1d84d61c-7230-4ec8-9349-b6550880fbbc_del complete
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.compute.manager [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 24 19:02:38 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.compute.manager [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Detaching volume b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.block_device [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attempting to driver detach volume b62462ba-5451-4732-80f3-cf043d5f6546 from mountpoint /dev/vdb
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Attempting to detach device vdb from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:02:38 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:38 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:02:38 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:02:38 user nova-compute[75051]:   <serial>b62462ba-5451-4732-80f3-cf043d5f6546</serial>
Nov 24 19:02:38 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:02:38 user nova-compute[75051]: </disk>
Nov 24 19:02:38 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:02:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully detached device vdb from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the persistent domain config.
Nov 24 19:02:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:38 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 19:02:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87744474-0a80-4572-a0c3-c92ba5d4464f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:02:39 user nova-compute[75051]: No targets found.
Nov 24 19:02:39 user nova-compute[75051]: iSNS:
Nov 24 19:02:39 user nova-compute[75051]: No targets found.
Nov 24 19:02:39 user nova-compute[75051]: STATIC:
Nov 24 19:02:39 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:02:39 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:02:39 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:02:39 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:02:39 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:02:39 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:02:39 user nova-compute[75051]: FIRMWARE:
Nov 24 19:02:39 user nova-compute[75051]: No targets found.
Nov 24 19:02:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:02:39 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:02:39 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01a885-4bf2-4a12-b67f-9d4612ac6266]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c7e6e-31d5-41ae-a304-e7c509b135e4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:39 user nova-compute[75051]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:39 user nova-compute[75051]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0383400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c75c1c-f1cf-42c6-827c-45138f7d6b4f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e808bb-55fb-4a4a-a785-4d609cd6af5c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a28c31-45f6-424a-90b4-53da4a6ca073]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f7ba4-2f91-42f1-951d-771ab5d75c76]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff7ce71-b41d-4c21-ae3d-ee761cf3c293]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8f4349-64cc-4b6b-b32a-e27b84617fdd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]
Nov 24 19:02:39 user nova-compute[75051]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.
Nov 24 19:02:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f9d14-c09d-4494-b102-d44523f3eaac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== disconnect_volume: return (336ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:39 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Took 0.71 seconds to deallocate network for instance.
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-36ebf1fa-5846-4e09-b962-c46f200a9b22 req-f7d8da6c-e9dd-4ed2-a34e-fe2383d8443d service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-deleted-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:39 user nova-compute[75051]: INFO nova.compute.manager [req-36ebf1fa-5846-4e09-b962-c46f200a9b22 req-f7d8da6c-e9dd-4ed2-a34e-fe2383d8443d service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Neutron deleted interface c824dedb-0eda-42c4-a5e0-a3aa7fdb9015; detaching it from the instance and deleting it from the info cache
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-36ebf1fa-5846-4e09-b962-c46f200a9b22 req-f7d8da6c-e9dd-4ed2-a34e-fe2383d8443d service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-36ebf1fa-5846-4e09-b962-c46f200a9b22 req-f7d8da6c-e9dd-4ed2-a34e-fe2383d8443d service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Detach interface failed, port_id=c824dedb-0eda-42c4-a5e0-a3aa7fdb9015, reason: Instance 1d84d61c-7230-4ec8-9349-b6550880fbbc could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:02:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state active and task_state rebuilding.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-unplugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Acquiring lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] No waiting events found dispatching network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a3801fb-fe41-4b4b-afa8-498c1c6fc1fc req-800331d5-bd92-4bb5-a811-170618ec4c71 service nova] [instance: 1d84d61c-7230-4ec8-9349-b6550880fbbc] Received unexpected event network-vif-plugged-c824dedb-0eda-42c4-a5e0-a3aa7fdb9015 for instance with vm_state deleted and task_state None.
Nov 24 19:02:40 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Deleted allocations for instance 1d84d61c-7230-4ec8-9349-b6550880fbbc
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-7a884a85-c30c-4c5f-a1a4-40e3c8468e28 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "1d84d61c-7230-4ec8-9349-b6550880fbbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.479s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance destroyed successfully.
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-ServerActionsTestOtherA-server-1582507679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc481b3ac-46, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2e985de-bd15-46c7-b043-8207e371ee72) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:40 user nova-compute[75051]: INFO os_vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46')
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d66afba-13b7-4c35-b587-b86aecc47c09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:02:40 user nova-compute[75051]: No targets found.
Nov 24 19:02:40 user nova-compute[75051]: iSNS:
Nov 24 19:02:40 user nova-compute[75051]: No targets found.
Nov 24 19:02:40 user nova-compute[75051]: STATIC:
Nov 24 19:02:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:02:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:02:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:02:40 user nova-compute[75051]: FIRMWARE:
Nov 24 19:02:40 user nova-compute[75051]: No targets found.
Nov 24 19:02:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:02:40 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:02:40 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14bc9a5-4636-4990-b31e-838efd1fd30d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff02bc34-6df5-460b-bfdb-9d0a4f82b325]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0440700>, {}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Disconnecting from: [] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== disconnect_volume: return (72ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:02:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Deleting instance files /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db_del
Nov 24 19:02:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Deletion of /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db_del complete
Nov 24 19:02:40 user nova-compute[75051]: INFO nova.virt.block_device [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Booting with volume b62462ba-5451-4732-80f3-cf043d5f6546 at /dev/vdb
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.utils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0199d6e-c304-4170-83de-8cc9722f682e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5369d447-e09f-492a-aa98-ed7702580178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[07951874-afae-4eea-8c6b-a56b25c6d573]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c63d65-40db-4424-9a30-c2a5e1da679b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:40 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:02:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6dfe36-3c59-4081-9c72-db9d432c6f50]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG os_brick.utils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:40 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating existing volume attachment record: e004cb53-6b42-48b5-9865-0d17f215c79b {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:02:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:02:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Creating image(s)
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk 1073741824" returned: 0 in 0.060s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Cannot resize image /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Ensure instance console log exists: /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start _get_guest_xml network_info=[{"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9359be0c-8d4b-4a3a-b2a6-371f108f39db', 'attached_at': '', 'detached_at': '', 'volume_id': 'b62462ba-5451-4732-80f3-cf043d5f6546', 'serial': 'b62462ba-5451-4732-80f3-cf043d5f6546'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'e004cb53-6b42-48b5-9865-0d17f215c79b', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:02:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 19:02:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:02:50 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ca13d-a00a-4fb4-b59f-29f88bc111f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:02:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ba060-d89d-4e20-8f62-849e44b378b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546] added
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[928187e4-678b-4496-9861-abaa0d8a1022]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3615de0-10ff-40b0-89e3-9fe0e22a8ba1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBtyjuOr {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vBtyjuOr" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[441888b6-300e-4ff0-96fb-061a816b20ef]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vBtyjuOr'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c45fd-a2b4-4a0b-a14d-edbdaa08d4e5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[064da516-58bc-429b-9986-99a073cbe204]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3874c-1f30-43de-9e97-9d52a9780d30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]
Nov 24 19:02:50 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d106b54-fb06-4a3b-a601-fd266cdff600]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797b1dc-7333-4eea-b08e-33cd21db6191]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:02:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[744a337f-6c68-46b8-8b97-2f1fc25aba9e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:02:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26232323965623738', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232323965623738', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-ServerActionsTestOtherA-server-1582507679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:02:51 user nova-compute[75051]:   <uuid>9359be0c-8d4b-4a3a-b2a6-371f108f39db</uuid>
Nov 24 19:02:51 user nova-compute[75051]:   <name>instance-00000016</name>
Nov 24 19:02:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:02:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:02:51 user nova-compute[75051]:   <metadata>
Nov 24 19:02:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:02:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherA-server-1582507679</nova:name>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:02:50</nova:creationTime>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:02:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:02:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:owner>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:user uuid="1542a899903c40dfba0d4b274b547b73">tempest-ServerActionsTestOtherA-214702841-project-member</nova:user>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:project uuid="9ae5e7665a994fe29c206c1b53c5359f">tempest-ServerActionsTestOtherA-214702841</nova:project>
Nov 24 19:02:51 user nova-compute[75051]:       </nova:owner>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:02:51 user nova-compute[75051]:       <nova:ports>
Nov 24 19:02:51 user nova-compute[75051]:         <nova:port uuid="c481b3ac-4641-4ab8-a878-9fb3b90ad8f0">
Nov 24 19:02:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:02:51 user nova-compute[75051]:         </nova:port>
Nov 24 19:02:51 user nova-compute[75051]:       </nova:ports>
Nov 24 19:02:51 user nova-compute[75051]:     </nova:instance>
Nov 24 19:02:51 user nova-compute[75051]:   </metadata>
Nov 24 19:02:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:02:51 user nova-compute[75051]:     <system>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="serial">9359be0c-8d4b-4a3a-b2a6-371f108f39db</entry>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="uuid">9359be0c-8d4b-4a3a-b2a6-371f108f39db</entry>
Nov 24 19:02:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:02:51 user nova-compute[75051]:     </system>
Nov 24 19:02:51 user nova-compute[75051]:   </sysinfo>
Nov 24 19:02:51 user nova-compute[75051]:   <os>
Nov 24 19:02:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:02:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:02:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:02:51 user nova-compute[75051]:   </os>
Nov 24 19:02:51 user nova-compute[75051]:   <features>
Nov 24 19:02:51 user nova-compute[75051]:     <acpi/>
Nov 24 19:02:51 user nova-compute[75051]:     <apic/>
Nov 24 19:02:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:02:51 user nova-compute[75051]:   </features>
Nov 24 19:02:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:02:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:02:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:02:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:02:51 user nova-compute[75051]:   </clock>
Nov 24 19:02:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:02:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:02:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:02:51 user nova-compute[75051]:   </cpu>
Nov 24 19:02:51 user nova-compute[75051]:   <devices>
Nov 24 19:02:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:02:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:02:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk"/>
Nov 24 19:02:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:02:51 user nova-compute[75051]:     </disk>
Nov 24 19:02:51 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:02:51 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:02:51 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:02:51 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:02:51 user nova-compute[75051]:       <serial>b62462ba-5451-4732-80f3-cf043d5f6546</serial>
Nov 24 19:02:51 user nova-compute[75051]:     </disk>
Nov 24 19:02:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:02:51 user nova-compute[75051]:       <mac address="fa:16:3e:df:67:89"/>
Nov 24 19:02:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:02:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:02:51 user nova-compute[75051]:       <target dev="tapc481b3ac-46"/>
Nov 24 19:02:51 user nova-compute[75051]:     </interface>
Nov 24 19:02:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:02:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/console.log" append="off"/>
Nov 24 19:02:51 user nova-compute[75051]:     </serial>
Nov 24 19:02:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:02:51 user nova-compute[75051]:     <video>
Nov 24 19:02:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:02:51 user nova-compute[75051]:     </video>
Nov 24 19:02:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:02:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:02:51 user nova-compute[75051]:     </rng>
Nov 24 19:02:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:02:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:02:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:02:51 user nova-compute[75051]:     </memballoon>
Nov 24 19:02:51 user nova-compute[75051]:   </devices>
Nov 24 19:02:51 user nova-compute[75051]: </domain>
Nov 24 19:02:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-ServerActionsTestOtherA-server-1582507679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG os_vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adb622b5-ed78-5d71-9e4e-50aa3a014a4d', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc481b3ac-46, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc481b3ac-46, col_values=(('qos', UUID('65118a20-9338-44f0-9a75-75638ae9eb1c')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc481b3ac-46, col_values=(('external_ids', {'iface-id': 'c481b3ac-4641-4ab8-a878-9fb3b90ad8f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:67:89', 'vm-uuid': '9359be0c-8d4b-4a3a-b2a6-371f108f39db'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:51 user nova-compute[75051]: INFO os_vif [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46')
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:02:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:df:67:89, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:02:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:53 user nova-compute[75051]: WARNING nova.compute.manager [req-bcbf61b2-2b42-4a34-ad2e-e96481ff4439 req-52078721-08c5-491d-a0f7-d175b5600f5e service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:02:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance spawned successfully.
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:02:55 user nova-compute[75051]: WARNING nova.compute.manager [req-c2dbf181-1e24-4337-b197-952b9d0fa37c req-89a81545-9b39-4ff1-a5e8-54400bf56bb4 service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state active and task_state rebuild_spawning.
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG nova.objects.instance [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75051) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 24 19:02:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-117932d3-b0dc-4240-ab42-192e8dc19f63 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.084s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:02:58 user nova-compute[75051]: INFO nova.compute.manager [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attaching volume a249db98-d231-4382-8de2-d378399cdb9e to /dev/vdb
Nov 24 19:02:58 user nova-compute[75051]: DEBUG os_brick.utils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334f411-3806-42f6-a8e6-ed4bf861f002]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed6ce17-085e-466e-ab6d-2393947251e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e889413e-d233-4ab9-8621-d73256185081]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d3b2e8-a2df-4919-a1d4-5350d014d912]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:02:59 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:02:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[886bfa8b-62b1-4cb4-95ae-4372110718fd]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG os_brick.utils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:02:59 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating existing volume attachment record: d2fcb8e1-4cc6-47ef-b6f9-af8e80c30d08 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:03:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnQsvFDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:03:05 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:03:05 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:03:05 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[347e417f-b147-43c3-a652-342adfbf296a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:03:05 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[682868d1-7f5b-4c55-9197-e5af27c0c766]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e] added
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ce95b-f165-4f1d-9547-0ddcf07ca7a1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e043c-6e70-4438-812d-0ca46ff4574f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnQsvFDd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnQsvFDd" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43c5265-d11a-4695-a165-41c902f5e42e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnQsvFDd'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb8ed38-1b3e-4a16-b383-5093dd4d7986]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8be7906-69ce-45a9-8418-9b8e546b13b5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b026f84e-6ebf-4545-9e51-be7237d460ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260]
Nov 24 19:03:05 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260] successful.
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdf7328-ee7f-42ca-982e-7f55f92d057d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f53333-3f36-46c1-8e6e-84c1765fd039]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:05 user nova-compute[75051]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)
Nov 24 19:03:05 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb309f69-5fef-4738-abf3-1131dd56dd36]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:05 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnQsvFDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26436373832376632', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436373832376632', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:03:06 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:03:06 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:03:06 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:03:06 user nova-compute[75051]:   <serial>a249db98-d231-4382-8de2-d378399cdb9e</serial>
Nov 24 19:03:06 user nova-compute[75051]: </disk>
Nov 24 19:03:06 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:03:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:03:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:03:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] No VIF found with MAC fa:16:3e:93:f0:e2, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:03:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0864c336-5d96-4702-80e6-393235442bdb tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.484s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:09 user nova-compute[75051]: INFO nova.compute.manager [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Detaching volume a249db98-d231-4382-8de2-d378399cdb9e
Nov 24 19:03:09 user nova-compute[75051]: INFO nova.virt.block_device [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Attempting to driver detach volume a249db98-d231-4382-8de2-d378399cdb9e from mountpoint /dev/vdb
Nov 24 19:03:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Attempting to detach device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:03:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:03:09 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:03:09 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:03:09 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:03:09 user nova-compute[75051]:   <serial>a249db98-d231-4382-8de2-d378399cdb9e</serial>
Nov 24 19:03:09 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:03:09 user nova-compute[75051]: </disk>
Nov 24 19:03:09 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:03:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the persistent domain config.
Nov 24 19:03:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:03:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:03:09 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:03:09 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:03:09 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:03:09 user nova-compute[75051]:   <serial>a249db98-d231-4382-8de2-d378399cdb9e</serial>
Nov 24 19:03:09 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:03:09 user nova-compute[75051]: </disk>
Nov 24 19:03:09 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:03:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:03:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:03:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:12 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:03:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:03:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:03:16 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7757MB free_disk=25.309200286865234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 59738ebd-376f-4f6b-b9e5-3177010fc54e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:03:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating instance_info_cache with network_info: [{"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-92037f21-165b-4e14-96c9-7656e6c4a2c4" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:03:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:03:28 user nova-compute[75051]: INFO nova.compute.claims [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Claim successful on node user
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:03:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.policy [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c951d62f40724a90b384adb0365e53eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8077e9c3a9ab404ba79b2d569a4f30db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:03:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 is timed out.
Nov 24 19:03:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully detached device vdb from instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 from the live domain config.
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnQsvFDd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:03:29 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:03:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Creating image(s)
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "/opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "/opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "/opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb28d8db-6c4f-451a-ab12-8274a9b908cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:03:29 user nova-compute[75051]: No targets found.
Nov 24 19:03:29 user nova-compute[75051]: iSNS:
Nov 24 19:03:29 user nova-compute[75051]: No targets found.
Nov 24 19:03:29 user nova-compute[75051]: STATIC:
Nov 24 19:03:29 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e
Nov 24 19:03:29 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:03:29 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:03:29 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c
Nov 24 19:03:29 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:03:29 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:03:29 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:03:29 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:03:29 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:03:29 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c
Nov 24 19:03:29 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:03:29 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:03:29 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:03:29 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:03:29 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:03:29 user nova-compute[75051]: FIRMWARE:
Nov 24 19:03:29 user nova-compute[75051]: No targets found.
Nov 24 19:03:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:03:29 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:03:29 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615abb1-73f9-4d1e-ad30-aa24b9a7598c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3854fdf-1207-4f21-bf59-3e41f15eab60]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c (non-flash)
Nov 24 19:03:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:687d0bc3-7e44-4d69-9387-16652f8f878c (non-flash)
Nov 24 19:03:29 user nova-compute[75051]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8f19f-2096-40c5-a0a6-f7a5178ac50c (non-flash)
Nov 24 19:03:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a04245e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5911aac5-1677-41a0-88a6-8568ae890126]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dd96dc-ae9a-4de1-855c-54509e6dae8d]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f9a2f2-c63d-4477-b19d-0919db2c67d8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.219s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b2d618-e00e-47f6-8c12-e9ae9c30c730]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:03:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc04a928-1ebb-4fcb-adc2-f424ef044954]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5b41a0-cec7-475a-857a-9dbcd1da97fa]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260]
Nov 24 19:03:30 user nova-compute[75051]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e, portal: 172.16.0.220,3260] successful.
Nov 24 19:03:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a249db98-d231-4382-8de2-d378399cdb9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ac384f-d715-45a7-a77f-2d0e03228b03]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] <== disconnect_volume: return (466ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.247s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk 1073741824" returned: 0 in 0.073s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Successfully created port: cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Cannot resize image /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Ensure instance console log exists: /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.objects.instance [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'flavor' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4bdc45fa-68f3-4a3c-80b0-ddb91933f95c tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Successfully updated port: cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquired lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-changed-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Refreshing instance network info cache due to event network-changed-cc0fd967-4eb9-4597-810c-45b46f91e542. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] Acquiring lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Updating instance_info_cache with network_info: [{"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Releasing lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Instance network_info: |[{"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] Acquired lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Refreshing network info cache for port cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Start _get_guest_xml network_info=[{"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:03:31 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:03:31 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-264075260',display_name='tempest-VolumesActionsTest-instance-264075260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-264075260',id=26,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-uwnwecdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:03:30Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=47bc5091-0dc7-4d76-863f-8e8b57899a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lazy-loading 'pci_devices' on Instance uuid 47bc5091-0dc7-4d76-863f-8e8b57899a3a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:03:31 user nova-compute[75051]:   <uuid>47bc5091-0dc7-4d76-863f-8e8b57899a3a</uuid>
Nov 24 19:03:31 user nova-compute[75051]:   <name>instance-0000001a</name>
Nov 24 19:03:31 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:03:31 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:03:31 user nova-compute[75051]:   <metadata>
Nov 24 19:03:31 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:03:31 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:name>tempest-VolumesActionsTest-instance-264075260</nova:name>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:03:31</nova:creationTime>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:03:31 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:03:31 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:owner>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:user uuid="c951d62f40724a90b384adb0365e53eb">tempest-VolumesActionsTest-2104762263-project-member</nova:user>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:project uuid="8077e9c3a9ab404ba79b2d569a4f30db">tempest-VolumesActionsTest-2104762263</nova:project>
Nov 24 19:03:31 user nova-compute[75051]:       </nova:owner>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:03:31 user nova-compute[75051]:       <nova:ports>
Nov 24 19:03:31 user nova-compute[75051]:         <nova:port uuid="cc0fd967-4eb9-4597-810c-45b46f91e542">
Nov 24 19:03:31 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 24 19:03:31 user nova-compute[75051]:         </nova:port>
Nov 24 19:03:31 user nova-compute[75051]:       </nova:ports>
Nov 24 19:03:31 user nova-compute[75051]:     </nova:instance>
Nov 24 19:03:31 user nova-compute[75051]:   </metadata>
Nov 24 19:03:31 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:03:31 user nova-compute[75051]:     <system>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="serial">47bc5091-0dc7-4d76-863f-8e8b57899a3a</entry>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="uuid">47bc5091-0dc7-4d76-863f-8e8b57899a3a</entry>
Nov 24 19:03:31 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:03:31 user nova-compute[75051]:     </system>
Nov 24 19:03:31 user nova-compute[75051]:   </sysinfo>
Nov 24 19:03:31 user nova-compute[75051]:   <os>
Nov 24 19:03:31 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:03:31 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:03:31 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:03:31 user nova-compute[75051]:   </os>
Nov 24 19:03:31 user nova-compute[75051]:   <features>
Nov 24 19:03:31 user nova-compute[75051]:     <acpi/>
Nov 24 19:03:31 user nova-compute[75051]:     <apic/>
Nov 24 19:03:31 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:03:31 user nova-compute[75051]:   </features>
Nov 24 19:03:31 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:03:31 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:03:31 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:03:31 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:03:31 user nova-compute[75051]:   </clock>
Nov 24 19:03:31 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:03:31 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:03:31 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:03:31 user nova-compute[75051]:   </cpu>
Nov 24 19:03:31 user nova-compute[75051]:   <devices>
Nov 24 19:03:31 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:03:31 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:03:31 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk"/>
Nov 24 19:03:31 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:03:31 user nova-compute[75051]:     </disk>
Nov 24 19:03:31 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:03:31 user nova-compute[75051]:       <mac address="fa:16:3e:fd:b2:01"/>
Nov 24 19:03:31 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:03:31 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:03:31 user nova-compute[75051]:       <target dev="tapcc0fd967-4e"/>
Nov 24 19:03:31 user nova-compute[75051]:     </interface>
Nov 24 19:03:31 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:03:31 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/console.log" append="off"/>
Nov 24 19:03:31 user nova-compute[75051]:     </serial>
Nov 24 19:03:31 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:03:31 user nova-compute[75051]:     <video>
Nov 24 19:03:31 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:03:31 user nova-compute[75051]:     </video>
Nov 24 19:03:31 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:03:31 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:03:31 user nova-compute[75051]:     </rng>
Nov 24 19:03:31 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:03:31 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:03:31 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:03:31 user nova-compute[75051]:     </memballoon>
Nov 24 19:03:31 user nova-compute[75051]:   </devices>
Nov 24 19:03:31 user nova-compute[75051]: </domain>
Nov 24 19:03:31 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-264075260',display_name='tempest-VolumesActionsTest-instance-264075260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-264075260',id=26,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-uwnwecdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:03:30Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=47bc5091-0dc7-4d76-863f-8e8b57899a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG os_vif [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10fce0d8-3085-5114-b008-c9dea74b7a3f', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc0fd967-4e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc0fd967-4e, col_values=(('qos', UUID('358c870f-795c-4a0d-9c7a-9727f8b15574')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc0fd967-4e, col_values=(('external_ids', {'iface-id': 'cc0fd967-4eb9-4597-810c-45b46f91e542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:b2:01', 'vm-uuid': '47bc5091-0dc7-4d76-863f-8e8b57899a3a'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:31 user nova-compute[75051]: INFO os_vif [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e')
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] No VIF found with MAC fa:16:3e:fd:b2:01, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:31 user nova-compute[75051]: INFO nova.compute.manager [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Terminating instance
Nov 24 19:03:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Updated VIF entry in instance network info cache for port cc0fd967-4eb9-4597-810c-45b46f91e542. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Updating instance_info_cache with network_info: [{"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedbbcda-905d-4ecb-ad81-bfe40467006d req-a8ee32e6-35e7-4a52-9863-3475fc9046c0 service nova] Releasing lock "refresh_cache-47bc5091-0dc7-4d76-863f-8e8b57899a3a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-unplugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] No waiting events found dispatching network-vif-unplugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:03:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee91e674-ba04-4b03-98a3-ffe282f90854 req-e611513b-4475-4971-b065-bb92db66cbe7 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-unplugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:03:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Instance destroyed successfully.
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lazy-loading 'resources' on Instance uuid 59738ebd-376f-4f6b-b9e5-3177010fc54e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-72581091',display_name='tempest-VolumesAdminNegativeTest-server-72581091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-72581091',id=18,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDme2wdpURNShBEyhGBmCvRN8QTHd0uG4zisZl49rqkKAO8L2GKDSkqp9sZC1jTuDrQftzBi2F96lT6Dm2CXS9gqG/mhS6z/frgE5KQWsuEDei569ylpSRjI1lftMgWsag==',key_name='tempest-keypair-500087197',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:57:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1d8b0e6ade24b3bb09c0860de12e31c',ramdisk_id='',reservation_id='r-nmgkafuq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-659921402',owner_user_name='tempest-VolumesAdminNegativeTest-659921402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d38ec62f093e46bc92c48a2194e69ab6',uuid=59738ebd-376f-4f6b-b9e5-3177010fc54e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converting VIF {"id": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "address": "fa:16:3e:32:3a:cc", "network": {"id": "de956cf0-3869-4cca-a602-6d09b79a6291", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1845083173-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1d8b0e6ade24b3bb09c0860de12e31c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d0f55b7-14", "ovs_interfaceid": "7d0f55b7-14e8-46af-b3d8-214a3ec965bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG os_vif [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d0f55b7-14, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=662c4469-755f-44ae-9fc3-6aeb8e535dce) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: INFO os_vif [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:3a:cc,bridge_name='br-int',has_traffic_filtering=True,id=7d0f55b7-14e8-46af-b3d8-214a3ec965bb,network=Network(de956cf0-3869-4cca-a602-6d09b79a6291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d0f55b7-14')
Nov 24 19:03:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Deleting instance files /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e_del
Nov 24 19:03:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Deletion of /opt/stack/data/nova/instances/59738ebd-376f-4f6b-b9e5-3177010fc54e_del complete
Nov 24 19:03:33 user nova-compute[75051]: INFO nova.compute.manager [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 24 19:03:33 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] No waiting events found dispatching network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:03:34 user nova-compute[75051]: WARNING nova.compute.manager [req-4d5b7d43-7ef8-4161-a791-1cd02d826c29 req-59e17f98-2b53-4fd6-9d89-95f216f502ff service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received unexpected event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 for instance with vm_state building and task_state spawning.
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] Acquiring lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] No waiting events found dispatching network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:03:34 user nova-compute[75051]: WARNING nova.compute.manager [req-48eaf8c8-fcbc-4a0d-9497-f50d429cd501 req-92879d0c-177c-4d83-afe3-71d160672de4 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received unexpected event network-vif-plugged-7d0f55b7-14e8-46af-b3d8-214a3ec965bb for instance with vm_state active and task_state deleting.
Nov 24 19:03:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:34 user nova-compute[75051]: INFO nova.compute.manager [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] instance snapshotting
Nov 24 19:03:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Beginning live snapshot process
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:03:34 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Took 1.46 seconds to deallocate network for instance.
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6.delta 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6.delta 1073741824" returned: 0 in 0.064s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:35 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:35 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Deleted allocations for instance 59738ebd-376f-4f6b-b9e5-3177010fc54e
Nov 24 19:03:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dfaea94d-2f9c-4c5b-b534-af6cc6acb692 tempest-VolumesAdminNegativeTest-659921402 tempest-VolumesAdminNegativeTest-659921402-project-member] Lock "59738ebd-376f-4f6b-b9e5-3177010fc54e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.613s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:03:36 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Instance spawned successfully.
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:03:36 user nova-compute[75051]: INFO nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:03:36 user nova-compute[75051]: INFO nova.compute.manager [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Took 7.48 seconds to build instance.
Nov 24 19:03:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ae293fbd-aa23-4bd0-9996-896a4d12b23e tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.625s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] No waiting events found dispatching network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:03:36 user nova-compute[75051]: WARNING nova.compute.manager [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received unexpected event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 for instance with vm_state active and task_state None.
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-848d2d97-5fd1-4631-9ab2-151f886abfee req-ca292bf9-3027-4a53-bfa9-ed1a1af97500 service nova] [instance: 59738ebd-376f-4f6b-b9e5-3177010fc54e] Received event network-vif-deleted-7d0f55b7-14e8-46af-b3d8-214a3ec965bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:03:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] COPY block job progress, current cursor: 25165824 final cursor: 75497472 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:03:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:03:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 19:03:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:37 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:03:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6.delta /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:03:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6.delta /opt/stack/data/nova/instances/snapshots/tmpt3ru_p2n/057692fd3e4545f5835c88be54cd18c6" returned: 0 in 0.463s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:03:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Snapshot extracted, beginning image upload
Nov 24 19:03:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Snapshot image upload complete
Nov 24 19:03:40 user nova-compute[75051]: INFO nova.compute.manager [None req-9a2b3e8f-3ecb-4ee3-8ac8-3d7548071dcd tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Took 5.85 seconds to snapshot the instance on the hypervisor.
Nov 24 19:03:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:03:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:03:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:04:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing instance network info cache due to event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] Acquiring lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] Acquired lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:14 user nova-compute[75051]: INFO nova.compute.manager [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Attaching volume 5f93fab7-5365-4755-9c33-cf627e1c960e to /dev/vdb
Nov 24 19:04:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updated VIF entry in instance network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating instance_info_cache with network_info: [{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ceb69447-fc29-490c-a266-48a0a151d99a req-8c0b25c7-ebde-4437-8540-184083c5d39b service nova] Releasing lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.utils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93437903-e4fe-4041-a228-f9e1bed583c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ee805-a34d-46b3-a3f0-4d2dc3afd438]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80b00d-52f7-453b-b926-dddcc465ff26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d096f8-a78c-45ed-b3e2-678e701b0b74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:04:14 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[85306444-d7f3-4674-8652-59995114adea]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG os_brick.utils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating existing volume attachment record: f8a341fa-5199-4366-9e2d-32d80aaa934a {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:17 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:04:17 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7877MB free_disk=25.247051239013672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 92037f21-165b-4e14-96c9-7656e6c4a2c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 47bc5091-0dc7-4d76-863f-8e8b57899a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:04:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:04:18 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:04:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:04:18 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:04:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTSNakOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:04:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:04:20 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:04:20 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce20eca-8b0f-4cc8-8c88-7519e83c841e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:04:20 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[286dfbd8-6e01-4947-8931-ee29131fa250]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e] added
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0a076-4e75-430c-ba8a-bbcf27870fca]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177b4fb-3b1c-452d-b611-73f18a389021]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTSNakOp {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTSNakOp" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[328edb72-326e-443c-870d-58a62516c040]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTSNakOp'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad5d0e-070b-465b-8022-5074e8f9e87c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5685315-764d-408e-9d78-b646f910e996]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b39c37f-c2a7-4a24-bbd3-1fbc46e97c54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260]
Nov 24 19:04:20 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260] successful.
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a2bf77-840b-41bf-b7af-0234875d447e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f46a0c-4866-4bb6-a7dd-275e9130a76f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:20 user nova-compute[75051]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)
Nov 24 19:04:20 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe3d69-a35a-489a-a931-bf1024730d44]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:04:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTSNakOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:04:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:04:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26461336335336161', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:04:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461336335336161', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:04:21 user nova-compute[75051]: DEBUG nova.objects.instance [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:04:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:04:21 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:04:21 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:04:21 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:04:21 user nova-compute[75051]:   <serial>5f93fab7-5365-4755-9c33-cf627e1c960e</serial>
Nov 24 19:04:21 user nova-compute[75051]: </disk>
Nov 24 19:04:21 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:04:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:04:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:04:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No VIF found with MAC fa:16:3e:65:d0:7e, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:04:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-10a85693-206f-4769-aec9-0daf8a269802 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.113s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:23 user nova-compute[75051]: INFO nova.compute.manager [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Terminating instance
Nov 24 19:04:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-unplugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] No waiting events found dispatching network-vif-unplugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:04:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-cf10d319-6700-467d-adfa-5636817766a7 req-35471c9e-c0ad-4342-9c0c-086db38e1bc9 service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-unplugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Instance destroyed successfully.
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.objects.instance [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lazy-loading 'resources' on Instance uuid 92037f21-165b-4e14-96c9-7656e6c4a2c4 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:57:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467361559',display_name='tempest-SnapshotDataIntegrityTests-server-467361559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467361559',id=17,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgEmrDJ+kvqkwhAFueAP8QmaUarIAHW4o/fnbCOvUi1ww3K9im44b37Q2V2qvcUSiXOJgUk6Yy2gLx9OHZ5OpLXCpMS7sUYF5iSMiAs8O0XFPL2K+NN2Ta7uc6rlYoqvg==',key_name='tempest-keypair-675822322',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:57:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c1f2356690c4e7eb341c4f0918c249e',ramdisk_id='',reservation_id='r-zujsj3vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1366443690',owner_user_name='tempest-SnapshotDataIntegrityTests-1366443690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2951a4e0d2a4655aff205ffbf47f0ba',uuid=92037f21-165b-4e14-96c9-7656e6c4a2c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converting VIF {"id": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "address": "fa:16:3e:93:f0:e2", "network": {"id": "2e3b3770-2574-4091-bc01-4ee2c09b6b5d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1251173192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c1f2356690c4e7eb341c4f0918c249e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ea9cb6-c0", "ovs_interfaceid": "69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG os_vif [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69ea9cb6-c0, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2d62f87-9872-4b6f-80d3-1625e5ffbce7) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:24 user nova-compute[75051]: INFO os_vif [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:f0:e2,bridge_name='br-int',has_traffic_filtering=True,id=69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1,network=Network(2e3b3770-2574-4091-bc01-4ee2c09b6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ea9cb6-c0')
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Deleting instance files /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4_del
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Deletion of /opt/stack/data/nova/instances/92037f21-165b-4e14-96c9-7656e6c4a2c4_del complete
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.compute.manager [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 19:04:24 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.compute.manager [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Detaching volume 5f93fab7-5365-4755-9c33-cf627e1c960e
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.virt.block_device [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Attempting to driver detach volume 5f93fab7-5365-4755-9c33-cf627e1c960e from mountpoint /dev/vdb
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Attempting to detach device vdb from instance 0a26aa8a-384a-4bb2-9952-61724355bee8 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:04:24 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:04:24 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:04:24 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:04:24 user nova-compute[75051]:   <serial>5f93fab7-5365-4755-9c33-cf627e1c960e</serial>
Nov 24 19:04:24 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:04:24 user nova-compute[75051]: </disk>
Nov 24 19:04:24 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:04:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully detached device vdb from instance 0a26aa8a-384a-4bb2-9952-61724355bee8 from the persistent domain config.
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a26aa8a-384a-4bb2-9952-61724355bee8 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:04:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:04:24 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:04:24 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:04:24 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:04:24 user nova-compute[75051]:   <serial>5f93fab7-5365-4755-9c33-cf627e1c960e</serial>
Nov 24 19:04:24 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:04:24 user nova-compute[75051]: </disk>
Nov 24 19:04:24 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:04:25 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Took 0.80 seconds to deallocate network for instance.
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-cb335cab-9cad-43bf-8def-e660b2eadfbd req-99e96212-c16e-442f-9804-12548cfaa9cc service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-deleted-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] Acquiring lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] No waiting events found dispatching network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:04:25 user nova-compute[75051]: WARNING nova.compute.manager [req-bff5b09a-26aa-4647-9ba0-3ab7dfc19a92 req-2c21bbaf-425c-443d-94f1-0a5f288d9b9d service nova] [instance: 92037f21-165b-4e14-96c9-7656e6c4a2c4] Received unexpected event network-vif-plugged-69ea9cb6-c0b0-4dc7-b084-fe57dc27d1d1 for instance with vm_state deleted and task_state None.
Nov 24 19:04:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:25 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Deleted allocations for instance 92037f21-165b-4e14-96c9-7656e6c4a2c4
Nov 24 19:04:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3b907364-d0e0-48c8-bf85-c7e0a757701d tempest-SnapshotDataIntegrityTests-1366443690 tempest-SnapshotDataIntegrityTests-1366443690-project-member] Lock "92037f21-165b-4e14-96c9-7656e6c4a2c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:04:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:04:42 user nova-compute[75051]: INFO nova.compute.claims [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Claim successful on node user
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:04:42 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:04:42 user nova-compute[75051]: DEBUG nova.policy [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88113529ca6747f281d4203c9c1d845f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ae7be1d57e44aae8c9b5695bba53ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:04:42 user nova-compute[75051]: INFO nova.virt.block_device [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Booting with volume-backed-image 5493a48f-5fd1-4417-ad27-dfb869ec17c2 at /dev/vda
Nov 24 19:04:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Successfully created port: 6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Successfully updated port: 6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-changed-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Refreshing instance network info cache due to event network-changed-6ad7e0da-34a4-4320-aa92-08c512ee482d. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] Acquiring lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance network_info: |[{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] Acquired lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:04:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Refreshing network info cache for port 6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:04:45 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a26aa8a-384a-4bb2-9952-61724355bee8 is timed out.
Nov 24 19:04:45 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully detached device vdb from instance 0a26aa8a-384a-4bb2-9952-61724355bee8 from the live domain config.
Nov 24 19:04:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTSNakOp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:04:45 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae0590-7ae3-415b-9b14-1f57f7c58da0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:04:45 user nova-compute[75051]: No targets found.
Nov 24 19:04:45 user nova-compute[75051]: iSNS:
Nov 24 19:04:45 user nova-compute[75051]: No targets found.
Nov 24 19:04:45 user nova-compute[75051]: STATIC:
Nov 24 19:04:45 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e
Nov 24 19:04:45 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:04:45 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:04:45 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:04:45 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:04:45 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:04:45 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:04:45 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:04:45 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:04:45 user nova-compute[75051]: FIRMWARE:
Nov 24 19:04:45 user nova-compute[75051]: No targets found.
Nov 24 19:04:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:04:45 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:04:45 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad92f41-ad02-4297-93f0-1562836dd24d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c976f-5333-4d65-b539-34c22235a777]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:45 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:45 user nova-compute[75051]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)
Nov 24 19:04:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:45 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:45 user nova-compute[75051]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e (non-flash)
Nov 24 19:04:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0280430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[538fb5fe-01a4-472f-ac2c-0e6e717849a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[400575fd-f5f5-4930-95ce-69dbf24927a1]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updated VIF entry in instance network info cache for port 6ad7e0da-34a4-4320-aa92-08c512ee482d. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281b6f4-12a3-4109-8f5d-0f4bcdf6258d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-67909bd4-45e8-4c2b-a95c-f49fdebdbb20 req-9d9cebb1-5939-45c7-99b5-f77c92330d53 service nova] Releasing lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edbba58-04ee-4523-8c5b-519cc0111858]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c082b-ce5c-4f35-8706-0bba9f9d5c4d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[628bea6f-ed77-46e4-a632-9286598fccf0]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260]
Nov 24 19:04:45 user nova-compute[75051]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e, portal: 172.16.0.220,3260] successful.
Nov 24 19:04:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f93fab7-5365-4755-9c33-cf627e1c960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09c677f-5198-4287-8ca6-22bde8537da1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== disconnect_volume: return (283ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:04:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:04:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:04:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cc21dff3-588d-4470-b45c-277c8531230a tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.666s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.utils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb5c78-6ca7-4060-ac97-5528c975e395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf0479-2e18-43e1-a7b4-0102918b40f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c6bb8e-07cf-4f62-90bf-a3f9b031396b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3766e331-940b-46a5-bacd-e94947936fd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:04:48 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:04:48 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9bd9fe-a182-402c-9cee-2da726e7ed75]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG os_brick.utils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:04:48 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating existing volume attachment record: 79332d72-dbda-433e-a317-32ac1a8e788c {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:04:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:04:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Creating image(s)
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Ensure instance console log exists: /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start _get_guest_xml network_info=[{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '253d389a-0014-4ae6-a631-e401cf63a697', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0bdb232-84c0-4a6c-9340-1c9662232235', 'serial': 'c0bdb232-84c0-4a6c-9340-1c9662232235'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '79332d72-dbda-433e-a317-32ac1a8e788c', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:04:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:04:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:04:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:04:55 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:04:55 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:04:55 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef6fb8c-f27d-4a62-949a-d212437593ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:04:55 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cefcaad-e021-4cb4-b459-324cbdfdc879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235] added
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb70278-f863-4a99-ba98-510cf54197e1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218d84c-01d5-46a2-bbef-96c6a49b049d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJAkDPSv {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJAkDPSv" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d553b70-0052-4c49-a05f-ce9550f52860]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJAkDPSv'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83962f71-e60d-4d8f-a4f5-626669aa16b2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[90376db5-924f-4624-943e-d5e71d89189d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7636df7-4f48-483a-83d5-79c6686bf4e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260]
Nov 24 19:04:55 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260] successful.
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd2a18-ae68-437f-948c-7f2dfdc7b020]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[333d3997-2a63-4ca9-8b98-4be70bad34e2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:04:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ba4067-11fe-425c-a17e-3db0d3eff840]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:04:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26263323064363934', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263323064363934', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-405124060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-405124060',id=27,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-b9vto5l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:04:43Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=253d389a-0014-4ae6-a631-e401cf63a697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:04:56 user nova-compute[75051]:   <uuid>253d389a-0014-4ae6-a631-e401cf63a697</uuid>
Nov 24 19:04:56 user nova-compute[75051]:   <name>instance-0000001b</name>
Nov 24 19:04:56 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:04:56 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:04:56 user nova-compute[75051]:   <metadata>
Nov 24 19:04:56 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:04:56 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-405124060</nova:name>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:04:54</nova:creationTime>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:04:56 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:04:56 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:owner>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 19:04:56 user nova-compute[75051]:       </nova:owner>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:04:56 user nova-compute[75051]:       <nova:ports>
Nov 24 19:04:56 user nova-compute[75051]:         <nova:port uuid="6ad7e0da-34a4-4320-aa92-08c512ee482d">
Nov 24 19:04:56 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:04:56 user nova-compute[75051]:         </nova:port>
Nov 24 19:04:56 user nova-compute[75051]:       </nova:ports>
Nov 24 19:04:56 user nova-compute[75051]:     </nova:instance>
Nov 24 19:04:56 user nova-compute[75051]:   </metadata>
Nov 24 19:04:56 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:04:56 user nova-compute[75051]:     <system>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="serial">253d389a-0014-4ae6-a631-e401cf63a697</entry>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="uuid">253d389a-0014-4ae6-a631-e401cf63a697</entry>
Nov 24 19:04:56 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:04:56 user nova-compute[75051]:     </system>
Nov 24 19:04:56 user nova-compute[75051]:   </sysinfo>
Nov 24 19:04:56 user nova-compute[75051]:   <os>
Nov 24 19:04:56 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:04:56 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:04:56 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:04:56 user nova-compute[75051]:   </os>
Nov 24 19:04:56 user nova-compute[75051]:   <features>
Nov 24 19:04:56 user nova-compute[75051]:     <acpi/>
Nov 24 19:04:56 user nova-compute[75051]:     <apic/>
Nov 24 19:04:56 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:04:56 user nova-compute[75051]:   </features>
Nov 24 19:04:56 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:04:56 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:04:56 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:04:56 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:04:56 user nova-compute[75051]:   </clock>
Nov 24 19:04:56 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:04:56 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:04:56 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:04:56 user nova-compute[75051]:   </cpu>
Nov 24 19:04:56 user nova-compute[75051]:   <devices>
Nov 24 19:04:56 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:04:56 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:04:56 user nova-compute[75051]:       <source dev="/dev/sdd"/>
Nov 24 19:04:56 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:04:56 user nova-compute[75051]:       <serial>c0bdb232-84c0-4a6c-9340-1c9662232235</serial>
Nov 24 19:04:56 user nova-compute[75051]:     </disk>
Nov 24 19:04:56 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:04:56 user nova-compute[75051]:       <mac address="fa:16:3e:07:92:99"/>
Nov 24 19:04:56 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:04:56 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:04:56 user nova-compute[75051]:       <target dev="tap6ad7e0da-34"/>
Nov 24 19:04:56 user nova-compute[75051]:     </interface>
Nov 24 19:04:56 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:04:56 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/console.log" append="off"/>
Nov 24 19:04:56 user nova-compute[75051]:     </serial>
Nov 24 19:04:56 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:04:56 user nova-compute[75051]:     <video>
Nov 24 19:04:56 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:04:56 user nova-compute[75051]:     </video>
Nov 24 19:04:56 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:04:56 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:04:56 user nova-compute[75051]:     </rng>
Nov 24 19:04:56 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:04:56 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:04:56 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:04:56 user nova-compute[75051]:     </memballoon>
Nov 24 19:04:56 user nova-compute[75051]:   </devices>
Nov 24 19:04:56 user nova-compute[75051]: </domain>
Nov 24 19:04:56 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-405124060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-405124060',id=27,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-b9vto5l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:04:43Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=253d389a-0014-4ae6-a631-e401cf63a697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG os_vif [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b628981-1fcb-5d03-b7d8-bf6425a09c81', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ad7e0da-34, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ad7e0da-34, col_values=(('qos', UUID('925d2117-e5d0-44e8-a5e1-ea72a56429e8')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ad7e0da-34, col_values=(('external_ids', {'iface-id': '6ad7e0da-34a4-4320-aa92-08c512ee482d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:92:99', 'vm-uuid': '253d389a-0014-4ae6-a631-e401cf63a697'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:56 user nova-compute[75051]: INFO os_vif [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34')
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:07:92:99, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:04:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:04:57 user nova-compute[75051]: WARNING nova.compute.manager [req-7dfc6145-e747-45a5-ab88-682e6c893960 req-8dd1325b-d77e-497e-8751-6cff26a7adbe service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state building and task_state spawning.
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:04:59 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance spawned successfully.
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:04:59 user nova-compute[75051]: INFO nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:04:59 user nova-compute[75051]: INFO nova.compute.manager [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Took 17.95 seconds to build instance.
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:04:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:04:59 user nova-compute[75051]: WARNING nova.compute.manager [req-21dfe85f-8016-49eb-bee6-a8cbdd82f4af req-71af358c-46dd-4142-9a0c-9b141c80e7b1 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state None.
Nov 24 19:04:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ad01b01a-6f2d-4a53-a272-eb8c0204efaf tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.045s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:05:10 user nova-compute[75051]: INFO nova.compute.claims [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Claim successful on node user
Nov 24 19:05:10 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:05:11 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.policy [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f06e00e20a4e41e4937e491f5c040ce8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b5db41f7d844d1fb6359146dc69065e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:05:11 user nova-compute[75051]: INFO nova.virt.block_device [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Booting with volume 9097e29f-8904-4b62-ba38-57b50ee5ea9d at /dev/vda
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.utils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[51944757-0923-45a4-8227-0e0df5166b1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d078910-5196-4bc4-a078-fc315449f915]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[446e8934-b807-498f-88a9-b04971e0a4c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d127720b-ad68-4995-a803-41315ee4d684]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:05:11 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18698f0-f552-4f02-898d-d396d5ae141f]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG os_brick.utils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating existing volume attachment record: 22fd0ecd-8293-4b46-a8f5-cca873ca8f7d {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Successfully created port: f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Successfully updated port: f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing instance network info cache due to event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:05:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance network_info: |[{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updated VIF entry in instance network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1f088299-40b0-4ca9-9c09-454d0e56b532 req-89b968b0-008e-458e-8637-53d4eba2a6e6 service nova] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:13 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:05:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:05:17 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:17 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.269939422607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9ed867b7-145b-4050-8633-2d6a18689a2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 47bc5091-0dc7-4d76-863f-8e8b57899a3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 253d389a-0014-4ae6-a631-e401cf63a697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 956f4b65-634b-4b22-b72c-d6df5ffff225 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:05:18 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Creating image(s)
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Ensure instance console log exists: /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start _get_guest_xml network_info=[{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '956f4b65-634b-4b22-b72c-d6df5ffff225', 'attached_at': '', 'detached_at': '', 'volume_id': '9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'serial': '9097e29f-8904-4b62-ba38-57b50ee5ea9d'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '22fd0ecd-8293-4b46-a8f5-cca873ca8f7d', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:05:18 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:18 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:05:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:05:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:05:18 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6dfda9-e247-499c-8064-bb2fa3b54499]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:05:18 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b823be27-3b57-4883-abcb-53365783464c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d] added
Nov 24 19:05:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30718b-f6d7-4255-ae5a-5d03def641f8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81d813e-6d6e-4f3c-9aad-b4aa522d4b60]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqfnUrMG {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqfnUrMG" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f14cc-91ec-4fe7-abe0-fdfa9437468b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqfnUrMG'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f3e93-6c4d-422d-90c9-98d556171040]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[91733b24-3426-4acf-aacd-51474c70b7b7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:05:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5592f-c6ba-48e2-9c2e-03facfe1c72b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]
Nov 24 19:05:19 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.
Nov 24 19:05:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.compute.manager [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Terminating instance
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a77a9c-b936-4389-9a82-afe0e4d89e82]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c821bf-474f-40e6-8d65-0f4269e8d033]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:05:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:19 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:05:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8044627c-07bd-4e6e-a501-b17d0300b035]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.compute.manager [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] instance snapshotting
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-unplugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] No waiting events found dispatching network-vif-unplugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [req-1340d451-71ff-4b75-be10-d8e04f103fdb req-1d91f5b7-2675-46a2-96b9-2b7b320319a9 service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-unplugged-cc0fd967-4eb9-4597-810c-45b46f91e542 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Beginning live snapshot process
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Instance destroyed successfully.
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.objects.instance [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lazy-loading 'resources' on Instance uuid 47bc5091-0dc7-4d76-863f-8e8b57899a3a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-264075260',display_name='tempest-VolumesActionsTest-instance-264075260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-264075260',id=26,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-uwnwecdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:03:36Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=47bc5091-0dc7-4d76-863f-8e8b57899a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "cc0fd967-4eb9-4597-810c-45b46f91e542", "address": "fa:16:3e:fd:b2:01", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc0fd967-4e", "ovs_interfaceid": "cc0fd967-4eb9-4597-810c-45b46f91e542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG os_vif [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc0fd967-4e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=358c870f-795c-4a0d-9c7a-9727f8b15574) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:19 user nova-compute[75051]: INFO os_vif [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b2:01,bridge_name='br-int',has_traffic_filtering=True,id=cc0fd967-4eb9-4597-810c-45b46f91e542,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc0fd967-4e')
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Deleting instance files /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a_del
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Deletion of /opt/stack/data/nova/instances/47bc5091-0dc7-4d76-863f-8e8b57899a3a_del complete
Nov 24 19:05:19 user nova-compute[75051]: INFO nova.compute.manager [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json -f qcow2 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93.delta 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '26166633531383062', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166633531383062', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93.delta 1073741824" returned: 0 in 0.052s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIipMsvh73b8rbg19gQpwcKIdPp+wX6vjE+/5Ty9em15V0xhsrgyyWosEe5+BheW5JFPEUyKwQh47zO/eSEM/CQNVCIcF1RmyGwC8E9sIlF40tbJKISmi1C3SwzsUlW+7g==',key_name='tempest-TestShelveInstance-1755056591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:05:11Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'pci_devices' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:05:20 user nova-compute[75051]:   <uuid>956f4b65-634b-4b22-b72c-d6df5ffff225</uuid>
Nov 24 19:05:20 user nova-compute[75051]:   <name>instance-0000001c</name>
Nov 24 19:05:20 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:05:20 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:05:20 user nova-compute[75051]:   <metadata>
Nov 24 19:05:20 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:05:20 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:05:20 user nova-compute[75051]:       <nova:name>tempest-TestShelveInstance-server-905072644</nova:name>
Nov 24 19:05:20 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:05:18</nova:creationTime>
Nov 24 19:05:20 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:05:20 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:05:20 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:05:20 user nova-compute[75051]:       <nova:owner>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:user uuid="f06e00e20a4e41e4937e491f5c040ce8">tempest-TestShelveInstance-1748776926-project-member</nova:user>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:project uuid="8b5db41f7d844d1fb6359146dc69065e">tempest-TestShelveInstance-1748776926</nova:project>
Nov 24 19:05:20 user nova-compute[75051]:       </nova:owner>
Nov 24 19:05:20 user nova-compute[75051]:       <nova:ports>
Nov 24 19:05:20 user nova-compute[75051]:         <nova:port uuid="f63c6b52-105f-4f6a-a33e-1450d9a99d6e">
Nov 24 19:05:20 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 19:05:20 user nova-compute[75051]:         </nova:port>
Nov 24 19:05:20 user nova-compute[75051]:       </nova:ports>
Nov 24 19:05:20 user nova-compute[75051]:     </nova:instance>
Nov 24 19:05:20 user nova-compute[75051]:   </metadata>
Nov 24 19:05:20 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:05:20 user nova-compute[75051]:     <system>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="serial">956f4b65-634b-4b22-b72c-d6df5ffff225</entry>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="uuid">956f4b65-634b-4b22-b72c-d6df5ffff225</entry>
Nov 24 19:05:20 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:05:20 user nova-compute[75051]:     </system>
Nov 24 19:05:20 user nova-compute[75051]:   </sysinfo>
Nov 24 19:05:20 user nova-compute[75051]:   <os>
Nov 24 19:05:20 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:05:20 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:05:20 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:05:20 user nova-compute[75051]:   </os>
Nov 24 19:05:20 user nova-compute[75051]:   <features>
Nov 24 19:05:20 user nova-compute[75051]:     <acpi/>
Nov 24 19:05:20 user nova-compute[75051]:     <apic/>
Nov 24 19:05:20 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:05:20 user nova-compute[75051]:   </features>
Nov 24 19:05:20 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:05:20 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:05:20 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:05:20 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:05:20 user nova-compute[75051]:   </clock>
Nov 24 19:05:20 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:05:20 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:05:20 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:05:20 user nova-compute[75051]:   </cpu>
Nov 24 19:05:20 user nova-compute[75051]:   <devices>
Nov 24 19:05:20 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:05:20 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:05:20 user nova-compute[75051]:       <source dev="/dev/sde"/>
Nov 24 19:05:20 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:05:20 user nova-compute[75051]:       <serial>9097e29f-8904-4b62-ba38-57b50ee5ea9d</serial>
Nov 24 19:05:20 user nova-compute[75051]:     </disk>
Nov 24 19:05:20 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:05:20 user nova-compute[75051]:       <mac address="fa:16:3e:35:bf:dd"/>
Nov 24 19:05:20 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:05:20 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:05:20 user nova-compute[75051]:       <target dev="tapf63c6b52-10"/>
Nov 24 19:05:20 user nova-compute[75051]:     </interface>
Nov 24 19:05:20 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:05:20 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225/console.log" append="off"/>
Nov 24 19:05:20 user nova-compute[75051]:     </serial>
Nov 24 19:05:20 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:05:20 user nova-compute[75051]:     <video>
Nov 24 19:05:20 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:05:20 user nova-compute[75051]:     </video>
Nov 24 19:05:20 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:05:20 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:05:20 user nova-compute[75051]:     </rng>
Nov 24 19:05:20 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:05:20 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:05:20 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:05:20 user nova-compute[75051]:     </memballoon>
Nov 24 19:05:20 user nova-compute[75051]:   </devices>
Nov 24 19:05:20 user nova-compute[75051]: </domain>
Nov 24 19:05:20 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIipMsvh73b8rbg19gQpwcKIdPp+wX6vjE+/5Ty9em15V0xhsrgyyWosEe5+BheW5JFPEUyKwQh47zO/eSEM/CQNVCIcF1RmyGwC8E9sIlF40tbJKISmi1C3SwzsUlW+7g==',key_name='tempest-TestShelveInstance-1755056591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:05:11Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG os_vif [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:05:20 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Took 0.50 seconds to deallocate network for instance.
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adeee833-e0b4-507e-af73-a76885cb6b19', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf63c6b52-10, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf63c6b52-10, col_values=(('qos', UUID('7a6a2932-663c-4aa9-b379-b2471ab2df5f')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf63c6b52-10, col_values=(('external_ids', {'iface-id': 'f63c6b52-105f-4f6a-a33e-1450d9a99d6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:bf:dd', 'vm-uuid': '956f4b65-634b-4b22-b72c-d6df5ffff225'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: INFO os_vif [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10')
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] No VIF found with MAC fa:16:3e:35:bf:dd, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:20 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Deleted allocations for instance 47bc5091-0dc7-4d76-863f-8e8b57899a3a
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-84805367-4e79-4cfd-9bec-29768f6ca0b1 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Skipping network cache update for instance because it is Building. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] COPY block job progress, current cursor: 25755648 final cursor: 75563008 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] Acquiring lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] Lock "47bc5091-0dc7-4d76-863f-8e8b57899a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] No waiting events found dispatching network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:21 user nova-compute[75051]: WARNING nova.compute.manager [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received unexpected event network-vif-plugged-cc0fd967-4eb9-4597-810c-45b46f91e542 for instance with vm_state deleted and task_state None.
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-3ff16877-8d02-4931-b5bb-715330bed729 req-780d446b-b19c-47bb-8c3f-d6bbc2d20c2d service nova] [instance: 47bc5091-0dc7-4d76-863f-8e8b57899a3a] Received event network-vif-deleted-cc0fd967-4eb9-4597-810c-45b46f91e542 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75051) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 24 19:05:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 24 19:05:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93.delta /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93.delta /opt/stack/data/nova/instances/snapshots/tmpzcg4_agx/2bd6582866dd4d1384b58d653b38cc93" returned: 0 in 0.551s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Snapshot extracted, beginning image upload
Nov 24 19:05:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:23 user nova-compute[75051]: WARNING nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state building and task_state spawning.
Nov 24 19:05:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:23 user nova-compute[75051]: WARNING nova.compute.manager [req-c2f82bf2-d6d7-4f31-833d-9ef57162b7d4 req-30d1beb3-602a-487f-a345-f69393c1a098 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state building and task_state spawning.
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:05:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance spawned successfully.
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:24 user nova-compute[75051]: INFO nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 24 19:05:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:05:24 user nova-compute[75051]: INFO nova.compute.manager [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Took 14.22 seconds to build instance.
Nov 24 19:05:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cb6da155-5b29-4695-8105-78a95fa25d12 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.318s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:25 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Snapshot image upload complete
Nov 24 19:05:25 user nova-compute[75051]: INFO nova.compute.manager [None req-91c45d69-1f68-4dc0-b96e-3e7389e37ecc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Took 6.24 seconds to snapshot the instance on the hypervisor.
Nov 24 19:05:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:05:28 user nova-compute[75051]: INFO nova.compute.claims [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Claim successful on node user
Nov 24 19:05:28 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:05:28 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:05:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.policy [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd837fbd543a9418d9c4e130bd2250a09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8060f2b760f4074b5a6827102cdb518', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:05:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Creating image(s)
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "/opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "/opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "/opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "ac45e371533afd3a1043356991edbe88601eb810" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "ac45e371533afd3a1043356991edbe88601eb810" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Successfully created port: 254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:30 user nova-compute[75051]: INFO nova.compute.manager [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Detaching volume b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:05:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.virt.images [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] da4c79e3-07d2-4a31-826f-3c4f82226728 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.part /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:30 user nova-compute[75051]: INFO nova.virt.block_device [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Attempting to driver detach volume b62462ba-5451-4732-80f3-cf043d5f6546 from mountpoint /dev/vdb
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Attempting to detach device vdb from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:05:30 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:05:30 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:05:30 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:05:30 user nova-compute[75051]:   <serial>b62462ba-5451-4732-80f3-cf043d5f6546</serial>
Nov 24 19:05:30 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:05:30 user nova-compute[75051]: </disk>
Nov 24 19:05:30 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:05:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully detached device vdb from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the persistent domain config.
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:05:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:05:30 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:05:30 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:05:30 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:05:30 user nova-compute[75051]:   <serial>b62462ba-5451-4732-80f3-cf043d5f6546</serial>
Nov 24 19:05:30 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:05:30 user nova-compute[75051]: </disk>
Nov 24 19:05:30 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.part /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.converted" returned: 0 in 0.408s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "ac45e371533afd3a1043356991edbe88601eb810" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.160s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Successfully updated port: 254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing instance network info cache due to event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] Acquiring lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] Acquired lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing network info cache for port 254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "ac45e371533afd3a1043356991edbe88601eb810" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "ac45e371533afd3a1043356991edbe88601eb810" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810,backing_fmt=raw /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810,backing_fmt=raw /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk 1073741824" returned: 0 in 0.049s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "ac45e371533afd3a1043356991edbe88601eb810" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e601d150-7d97-4196-a649-9c9b5ea3d4cc req-c63082a3-083d-4fe9-aefd-0b69caea1bc6 service nova] Releasing lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquired lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:05:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810 --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Ensure instance console log exists: /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.network.neutron [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [{"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Releasing lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance network_info: |[{"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Start _get_guest_xml network_info=[{"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='78765a9681587889630fb8d077537b54',container_format='bare',created_at=2023-11-24T19:05:19Z,direct_url=<?>,disk_format='qcow2',id=da4c79e3-07d2-4a31-826f-3c4f82226728,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1211028252',owner='a8060f2b760f4074b5a6827102cdb518',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-24T19:05:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'da4c79e3-07d2-4a31-826f-3c4f82226728'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:05:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='78765a9681587889630fb8d077537b54',container_format='bare',created_at=2023-11-24T19:05:19Z,direct_url=<?>,disk_format='qcow2',id=da4c79e3-07d2-4a31-826f-3c4f82226728,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1211028252',owner='a8060f2b760f4074b5a6827102cdb518',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-24T19:05:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-68209113',display_name='tempest-TestStampPattern-server-68209113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-68209113',id=29,image_ref='da4c79e3-07d2-4a31-826f-3c4f82226728',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-ph9n6pf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a26aa8a-384a-4bb2-9952-61724355bee8',image_min_disk='1',image_min_ram='0',image_owner_id='a8060f2b760f4074b5a6827102cdb518',image_owner_project_name='tempest-TestStampPattern-1820980037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1820980037-project-member',image_user_id='d837fbd543a9418d9c4e130bd2250a09',network_allocated='True',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:05:29Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=d82b90d0-83ce-4c6d-b345-6011c8e2dc24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.objects.instance [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'pci_devices' on Instance uuid d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:05:32 user nova-compute[75051]:   <uuid>d82b90d0-83ce-4c6d-b345-6011c8e2dc24</uuid>
Nov 24 19:05:32 user nova-compute[75051]:   <name>instance-0000001d</name>
Nov 24 19:05:32 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:05:32 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:05:32 user nova-compute[75051]:   <metadata>
Nov 24 19:05:32 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:05:32 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:name>tempest-TestStampPattern-server-68209113</nova:name>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:05:32</nova:creationTime>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:05:32 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:05:32 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:owner>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:user uuid="d837fbd543a9418d9c4e130bd2250a09">tempest-TestStampPattern-1820980037-project-member</nova:user>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:project uuid="a8060f2b760f4074b5a6827102cdb518">tempest-TestStampPattern-1820980037</nova:project>
Nov 24 19:05:32 user nova-compute[75051]:       </nova:owner>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:root type="image" uuid="da4c79e3-07d2-4a31-826f-3c4f82226728"/>
Nov 24 19:05:32 user nova-compute[75051]:       <nova:ports>
Nov 24 19:05:32 user nova-compute[75051]:         <nova:port uuid="254bade7-a1f1-4197-ad8e-07e2928b81e5">
Nov 24 19:05:32 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 19:05:32 user nova-compute[75051]:         </nova:port>
Nov 24 19:05:32 user nova-compute[75051]:       </nova:ports>
Nov 24 19:05:32 user nova-compute[75051]:     </nova:instance>
Nov 24 19:05:32 user nova-compute[75051]:   </metadata>
Nov 24 19:05:32 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:05:32 user nova-compute[75051]:     <system>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="serial">d82b90d0-83ce-4c6d-b345-6011c8e2dc24</entry>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="uuid">d82b90d0-83ce-4c6d-b345-6011c8e2dc24</entry>
Nov 24 19:05:32 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:05:32 user nova-compute[75051]:     </system>
Nov 24 19:05:32 user nova-compute[75051]:   </sysinfo>
Nov 24 19:05:32 user nova-compute[75051]:   <os>
Nov 24 19:05:32 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:05:32 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:05:32 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:05:32 user nova-compute[75051]:   </os>
Nov 24 19:05:32 user nova-compute[75051]:   <features>
Nov 24 19:05:32 user nova-compute[75051]:     <acpi/>
Nov 24 19:05:32 user nova-compute[75051]:     <apic/>
Nov 24 19:05:32 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:05:32 user nova-compute[75051]:   </features>
Nov 24 19:05:32 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:05:32 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:05:32 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:05:32 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:05:32 user nova-compute[75051]:   </clock>
Nov 24 19:05:32 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:05:32 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:05:32 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:05:32 user nova-compute[75051]:   </cpu>
Nov 24 19:05:32 user nova-compute[75051]:   <devices>
Nov 24 19:05:32 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:05:32 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:05:32 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk"/>
Nov 24 19:05:32 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:05:32 user nova-compute[75051]:     </disk>
Nov 24 19:05:32 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:05:32 user nova-compute[75051]:       <mac address="fa:16:3e:1d:3a:2e"/>
Nov 24 19:05:32 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:05:32 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:05:32 user nova-compute[75051]:       <target dev="tap254bade7-a1"/>
Nov 24 19:05:32 user nova-compute[75051]:     </interface>
Nov 24 19:05:32 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:05:32 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/console.log" append="off"/>
Nov 24 19:05:32 user nova-compute[75051]:     </serial>
Nov 24 19:05:32 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:05:32 user nova-compute[75051]:     <video>
Nov 24 19:05:32 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:05:32 user nova-compute[75051]:     </video>
Nov 24 19:05:32 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:05:32 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:05:32 user nova-compute[75051]:     </rng>
Nov 24 19:05:32 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:05:32 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:05:32 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:05:32 user nova-compute[75051]:     </memballoon>
Nov 24 19:05:32 user nova-compute[75051]:   </devices>
Nov 24 19:05:32 user nova-compute[75051]: </domain>
Nov 24 19:05:32 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-68209113',display_name='tempest-TestStampPattern-server-68209113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-68209113',id=29,image_ref='da4c79e3-07d2-4a31-826f-3c4f82226728',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-ph9n6pf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a26aa8a-384a-4bb2-9952-61724355bee8',image_min_disk='1',image_min_ram='0',image_owner_id='a8060f2b760f4074b5a6827102cdb518',image_owner_project_name='tempest-TestStampPattern-1820980037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1820980037-project-member',image_user_id='d837fbd543a9418d9c4e130bd2250a09',network_allocated='True',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:05:29Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=d82b90d0-83ce-4c6d-b345-6011c8e2dc24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG os_vif [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8d2e8a7-5b76-559f-a5c7-f3e997953b19', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254bade7-a1, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap254bade7-a1, col_values=(('qos', UUID('340ca852-9e02-45ae-bfca-7f6e0b9a7922')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap254bade7-a1, col_values=(('external_ids', {'iface-id': '254bade7-a1f1-4197-ad8e-07e2928b81e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:3a:2e', 'vm-uuid': 'd82b90d0-83ce-4c6d-b345-6011c8e2dc24'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:32 user nova-compute[75051]: INFO os_vif [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1')
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:05:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No VIF found with MAC fa:16:3e:1d:3a:2e, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:33 user nova-compute[75051]: WARNING nova.compute.manager [req-e12699c2-8cf9-4d61-89bf-c0df04cdf0fb req-af059600-0ac4-4524-939d-6a885d7391d3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state building and task_state spawning.
Nov 24 19:05:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:05:35 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance spawned successfully.
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:35 user nova-compute[75051]: WARNING nova.compute.manager [req-4a6c9110-b99d-47ee-b01e-361183c9422f req-135ea64d-a776-4452-ac1b-8ad8668d1cb3 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state building and task_state spawning.
Nov 24 19:05:35 user nova-compute[75051]: INFO nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 24 19:05:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:05:36 user nova-compute[75051]: INFO nova.compute.manager [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Took 7.51 seconds to build instance.
Nov 24 19:05:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-009776b2-0f20-4719-a2de-5fda6f78a6b2 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.609s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:45 user nova-compute[75051]: INFO nova.compute.manager [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Terminating instance
Nov 24 19:05:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:05:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-unplugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] No waiting events found dispatching network-vif-unplugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-ccce38d3-d6a9-415d-89c0-3e9cc3df21fb req-a9a36f38-e797-4c13-b536-22e7712fc93d service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-unplugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Instance destroyed successfully.
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lazy-loading 'resources' on Instance uuid 9ed867b7-145b-4050-8633-2d6a18689a2a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-489012342',display_name='tempest-ServersNegativeTestJSON-server-489012342',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-489012342',id=16,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:57:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='701cf22125304244b65b7e59708d8c50',ramdisk_id='',reservation_id='r-t4fhpzit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1710506599',owner_user_name='tempest-ServersNegativeTestJSON-1710506599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:57:07Z,user_data=None,user_id='21aa87c3247a4fb8acb794cff1ee372c',uuid=9ed867b7-145b-4050-8633-2d6a18689a2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converting VIF {"id": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "address": "fa:16:3e:de:19:e7", "network": {"id": "edc63346-21af-480b-a999-b57a65781cda", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-730801933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "701cf22125304244b65b7e59708d8c50", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fbd8cc4-99", "ovs_interfaceid": "7fbd8cc4-9932-4bb4-820d-06ed5c779bf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG os_vif [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fbd8cc4-99, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ee75969-e20e-41f5-bb84-ce8fef0f25ee) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:46 user nova-compute[75051]: INFO os_vif [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:19:e7,bridge_name='br-int',has_traffic_filtering=True,id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4,network=Network(edc63346-21af-480b-a999-b57a65781cda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fbd8cc4-99')
Nov 24 19:05:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Deleting instance files /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a_del
Nov 24 19:05:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Deletion of /opt/stack/data/nova/instances/9ed867b7-145b-4050-8633-2d6a18689a2a_del complete
Nov 24 19:05:46 user nova-compute[75051]: INFO nova.compute.manager [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 24 19:05:46 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:05:46 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:47 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Took 0.44 seconds to deallocate network for instance.
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-05c22720-3003-4407-abb4-7269ee8fb65a req-d4b67887-e81d-45a7-8d8c-256d72a92bf7 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-deleted-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:47 user nova-compute[75051]: INFO nova.compute.manager [req-05c22720-3003-4407-abb4-7269ee8fb65a req-d4b67887-e81d-45a7-8d8c-256d72a92bf7 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Neutron deleted interface 7fbd8cc4-9932-4bb4-820d-06ed5c779bf4; detaching it from the instance and deleting it from the info cache
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-05c22720-3003-4407-abb4-7269ee8fb65a req-d4b67887-e81d-45a7-8d8c-256d72a92bf7 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-05c22720-3003-4407-abb4-7269ee8fb65a req-d4b67887-e81d-45a7-8d8c-256d72a92bf7 service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Detach interface failed, port_id=7fbd8cc4-9932-4bb4-820d-06ed5c779bf4, reason: Instance 9ed867b7-145b-4050-8633-2d6a18689a2a could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:05:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:47 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Deleted allocations for instance 9ed867b7-145b-4050-8633-2d6a18689a2a
Nov 24 19:05:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-36d5fa25-eb23-4b3f-a802-a793a4b2b839 tempest-ServersNegativeTestJSON-1710506599 tempest-ServersNegativeTestJSON-1710506599-project-member] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:05:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] Acquiring lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:05:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:05:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] Lock "9ed867b7-145b-4050-8633-2d6a18689a2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] No waiting events found dispatching network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:05:48 user nova-compute[75051]: WARNING nova.compute.manager [req-82508785-fc9c-4eba-ad38-79d79c6eb889 req-16029f25-84df-4351-a191-6a1fc42aa36a service nova] [instance: 9ed867b7-145b-4050-8633-2d6a18689a2a] Received unexpected event network-vif-plugged-7fbd8cc4-9932-4bb4-820d-06ed5c779bf4 for instance with vm_state deleted and task_state None.
Nov 24 19:05:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db is timed out.
Nov 24 19:05:51 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully detached device vdb from instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db from the live domain config.
Nov 24 19:05:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vBtyjuOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:05:51 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c6942-1334-461c-8d52-9cc0d913beb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:05:51 user nova-compute[75051]: No targets found.
Nov 24 19:05:51 user nova-compute[75051]: iSNS:
Nov 24 19:05:51 user nova-compute[75051]: No targets found.
Nov 24 19:05:51 user nova-compute[75051]: STATIC:
Nov 24 19:05:51 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:05:51 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:05:51 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:05:51 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:05:51 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:05:51 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:05:51 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:05:51 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:05:51 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:05:51 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546
Nov 24 19:05:51 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:05:51 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:05:51 user nova-compute[75051]: FIRMWARE:
Nov 24 19:05:51 user nova-compute[75051]: No targets found.
Nov 24 19:05:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:05:51 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:05:51 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b207b7b-25b6-4687-a018-74f644b40c12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8737479-8f9f-44f6-90c0-18094c199c4a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:05:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:05:51 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:05:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0598310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdddb729-4ec1-4ccc-94bf-e411a289e2c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc72bb7b-fd99-491a-8cfa-3808b62539d8]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7da16b-d9f7-40ab-addf-77711914175b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d549a6db-8726-458e-a6be-e2a82970a4d3]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffbe8d-dd76-43ee-a105-56a1be48ab61]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[89300b2c-6558-47e1-9bda-06443d3eb1da]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260]
Nov 24 19:05:51 user nova-compute[75051]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546, portal: 172.16.0.220,3260] successful.
Nov 24 19:05:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b62462ba-5451-4732-80f3-cf043d5f6546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935f3ad-8aa6-43dc-a0d0-a96433bd5d5e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== disconnect_volume: return (292ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:05:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:05:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'flavor' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:05:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1831db37-49f5-453c-a092-1a5a1d8e0c0d tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.929s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:05:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:05:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:06:10 user nova-compute[75051]: INFO nova.compute.claims [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Claim successful on node user
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:06:11 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.policy [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c951d62f40724a90b384adb0365e53eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8077e9c3a9ab404ba79b2d569a4f30db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:06:11 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Creating image(s)
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "/opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "/opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk 1073741824" returned: 0 in 0.055s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Successfully created port: 2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.233s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Cannot resize image /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Ensure instance console log exists: /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Successfully updated port: 2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquired lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-changed-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Refreshing instance network info cache due to event network-changed-2166f78c-a675-409f-a2ff-092b21b32fef. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] Acquiring lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:06:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Updating instance_info_cache with network_info: [{"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Releasing lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Instance network_info: |[{"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] Acquired lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Refreshing network info cache for port 2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Start _get_guest_xml network_info=[{"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:06:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:13 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67374235',display_name='tempest-VolumesActionsTest-instance-67374235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67374235',id=30,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-jgp3bu9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:06:11Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=cb2775e4-7c40-4e39-9be0-c9b992ef45f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lazy-loading 'pci_devices' on Instance uuid cb2775e4-7c40-4e39-9be0-c9b992ef45f1 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:06:13 user nova-compute[75051]:   <uuid>cb2775e4-7c40-4e39-9be0-c9b992ef45f1</uuid>
Nov 24 19:06:13 user nova-compute[75051]:   <name>instance-0000001e</name>
Nov 24 19:06:13 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:06:13 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:06:13 user nova-compute[75051]:   <metadata>
Nov 24 19:06:13 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:06:13 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:name>tempest-VolumesActionsTest-instance-67374235</nova:name>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:06:13</nova:creationTime>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:06:13 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:06:13 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:owner>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:user uuid="c951d62f40724a90b384adb0365e53eb">tempest-VolumesActionsTest-2104762263-project-member</nova:user>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:project uuid="8077e9c3a9ab404ba79b2d569a4f30db">tempest-VolumesActionsTest-2104762263</nova:project>
Nov 24 19:06:13 user nova-compute[75051]:       </nova:owner>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:06:13 user nova-compute[75051]:       <nova:ports>
Nov 24 19:06:13 user nova-compute[75051]:         <nova:port uuid="2166f78c-a675-409f-a2ff-092b21b32fef">
Nov 24 19:06:13 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:06:13 user nova-compute[75051]:         </nova:port>
Nov 24 19:06:13 user nova-compute[75051]:       </nova:ports>
Nov 24 19:06:13 user nova-compute[75051]:     </nova:instance>
Nov 24 19:06:13 user nova-compute[75051]:   </metadata>
Nov 24 19:06:13 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:06:13 user nova-compute[75051]:     <system>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="serial">cb2775e4-7c40-4e39-9be0-c9b992ef45f1</entry>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="uuid">cb2775e4-7c40-4e39-9be0-c9b992ef45f1</entry>
Nov 24 19:06:13 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:06:13 user nova-compute[75051]:     </system>
Nov 24 19:06:13 user nova-compute[75051]:   </sysinfo>
Nov 24 19:06:13 user nova-compute[75051]:   <os>
Nov 24 19:06:13 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:06:13 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:06:13 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:06:13 user nova-compute[75051]:   </os>
Nov 24 19:06:13 user nova-compute[75051]:   <features>
Nov 24 19:06:13 user nova-compute[75051]:     <acpi/>
Nov 24 19:06:13 user nova-compute[75051]:     <apic/>
Nov 24 19:06:13 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:06:13 user nova-compute[75051]:   </features>
Nov 24 19:06:13 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:06:13 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:06:13 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:06:13 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:06:13 user nova-compute[75051]:   </clock>
Nov 24 19:06:13 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:06:13 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:06:13 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:06:13 user nova-compute[75051]:   </cpu>
Nov 24 19:06:13 user nova-compute[75051]:   <devices>
Nov 24 19:06:13 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:06:13 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:06:13 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk"/>
Nov 24 19:06:13 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:06:13 user nova-compute[75051]:     </disk>
Nov 24 19:06:13 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:06:13 user nova-compute[75051]:       <mac address="fa:16:3e:10:e9:32"/>
Nov 24 19:06:13 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:13 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:06:13 user nova-compute[75051]:       <target dev="tap2166f78c-a6"/>
Nov 24 19:06:13 user nova-compute[75051]:     </interface>
Nov 24 19:06:13 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:06:13 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/console.log" append="off"/>
Nov 24 19:06:13 user nova-compute[75051]:     </serial>
Nov 24 19:06:13 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:06:13 user nova-compute[75051]:     <video>
Nov 24 19:06:13 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:13 user nova-compute[75051]:     </video>
Nov 24 19:06:13 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:06:13 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:06:13 user nova-compute[75051]:     </rng>
Nov 24 19:06:13 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:06:13 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:06:13 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:06:13 user nova-compute[75051]:     </memballoon>
Nov 24 19:06:13 user nova-compute[75051]:   </devices>
Nov 24 19:06:13 user nova-compute[75051]: </domain>
Nov 24 19:06:13 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67374235',display_name='tempest-VolumesActionsTest-instance-67374235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67374235',id=30,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-jgp3bu9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:06:11Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=cb2775e4-7c40-4e39-9be0-c9b992ef45f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG os_vif [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80faad31-90ca-50f0-a99e-a7f7d38afb06', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2166f78c-a6, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2166f78c-a6, col_values=(('qos', UUID('b9787393-c7d6-4f2e-a371-069267063f92')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2166f78c-a6, col_values=(('external_ids', {'iface-id': '2166f78c-a675-409f-a2ff-092b21b32fef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:e9:32', 'vm-uuid': 'cb2775e4-7c40-4e39-9be0-c9b992ef45f1'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:13 user nova-compute[75051]: INFO os_vif [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6')
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] No VIF found with MAC fa:16:3e:10:e9:32, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Updated VIF entry in instance network info cache for port 2166f78c-a675-409f-a2ff-092b21b32fef. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Updating instance_info_cache with network_info: [{"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fb981ad4-c3f3-4836-9690-2359c936ace7 req-d97c2e32-a3b3-4bba-8a1e-dc9453481649 service nova] Releasing lock "refresh_cache-cb2775e4-7c40-4e39-9be0-c9b992ef45f1" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:14 user nova-compute[75051]: WARNING nova.compute.manager [req-cd5a35fc-fb35-4292-b6b0-2ce342e750f6 req-99c80af5-e499-4288-bb40-6e47dc987056 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state building and task_state spawning.
Nov 24 19:06:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:15 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:06:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Instance spawned successfully.
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:16 user nova-compute[75051]: INFO nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:16 user nova-compute[75051]: WARNING nova.compute.manager [req-8ab591b3-4b46-4615-978a-b3dc8daa0884 req-acd58d7e-a7f4-4dd8-ab75-0d1e7a8502a2 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state building and task_state spawning.
Nov 24 19:06:16 user nova-compute[75051]: INFO nova.compute.manager [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Took 6.11 seconds to build instance.
Nov 24 19:06:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-dee283b1-453c-465b-8711-5f37d9da1a3d tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.211s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:06:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:06:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.168701171875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 253d389a-0014-4ae6-a631-e401cf63a697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 956f4b65-634b-4b22-b72c-d6df5ffff225 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance cb2775e4-7c40-4e39-9be0-c9b992ef45f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:06:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:21 user nova-compute[75051]: INFO nova.compute.manager [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Terminating instance
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6ad2e064-a440-4301-8bfb-1fd2710ecf44 req-e8c7725c-fee4-40d9-b2d9-4b731958f01c service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-unplugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:06:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Instance destroyed successfully.
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'resources' on Instance uuid 9359be0c-8d4b-4a3a-b2a6-371f108f39db {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-934943927',display_name='tempest-ServerActionsTestOtherA-server-1582507679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-934943927',id=22,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFWY9lC3LPLhxDr0dHhcgK+lK1zEZnnh0vJwOlgfiGWIxw2mPDKim6dY09CWRp6fkOq9ZcgCXKanre3N3ighLfpfRE0YydHaxp8BvxCqRrVzfNs1CcnZSKpvAkurr/uqA==',key_name='tempest-keypair-146160996',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:02:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-tv4z9c3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=9359be0c-8d4b-4a3a-b2a6-371f108f39db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "address": "fa:16:3e:df:67:89", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc481b3ac-46", "ovs_interfaceid": "c481b3ac-4641-4ab8-a878-9fb3b90ad8f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG os_vif [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc481b3ac-46, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65118a20-9338-44f0-9a75-75638ae9eb1c) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:21 user nova-compute[75051]: INFO os_vif [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:67:89,bridge_name='br-int',has_traffic_filtering=True,id=c481b3ac-4641-4ab8-a878-9fb3b90ad8f0,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc481b3ac-46')
Nov 24 19:06:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Deleting instance files /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db_del
Nov 24 19:06:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Deletion of /opt/stack/data/nova/instances/9359be0c-8d4b-4a3a-b2a6-371f108f39db_del complete
Nov 24 19:06:21 user nova-compute[75051]: INFO nova.compute.manager [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 24 19:06:21 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:06:21 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [{"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-71e108a3-b5c9-4ffa-ad9c-21597ebc43df" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:22 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Took 0.70 seconds to deallocate network for instance.
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:06:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:23 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Deleted allocations for instance 9359be0c-8d4b-4a3a-b2a6-371f108f39db
Nov 24 19:06:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e030170b-3ed7-4ee8-bab8-5bce351fc9fc tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] Acquiring lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] Lock "9359be0c-8d4b-4a3a-b2a6-371f108f39db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] No waiting events found dispatching network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:23 user nova-compute[75051]: WARNING nova.compute.manager [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received unexpected event network-vif-plugged-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 for instance with vm_state deleted and task_state None.
Nov 24 19:06:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-e204e57a-e4f6-4ffb-a0f6-b85a1e5c4ae7 req-2e1dc655-02bd-4df5-8dad-7e42fd4291da service nova] [instance: 9359be0c-8d4b-4a3a-b2a6-371f108f39db] Received event network-vif-deleted-c481b3ac-4641-4ab8-a878-9fb3b90ad8f0 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:32 user nova-compute[75051]: INFO nova.compute.manager [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Rescuing
Nov 24 19:06:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:32 user nova-compute[75051]: DEBUG nova.network.neutron [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:33 user nova-compute[75051]: WARNING nova.compute.manager [req-bb637dab-2026-484c-92a7-b55e24175043 req-f680928b-e2a5-4a25-9202-23b8f36df11b service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state rescuing.
Nov 24 19:06:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance destroyed successfully.
Nov 24 19:06:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Attempting a stable device rescue
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 19:06:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Creating image(s)
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'trusted_certs' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG nova.virt.images [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] 8b9e549b-439b-4d3b-9e18-428ad8f46467 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.part /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:35 user nova-compute[75051]: WARNING nova.compute.manager [req-58357455-00e8-4890-af35-91b1a7732594 req-88f4def5-8a96-4ab7-bd15-a0b12ca9d161 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state rescuing.
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.part /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.converted" returned: 0 in 0.368s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.932s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4 --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4,backing_fmt=raw /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4,backing_fmt=raw /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue" returned: 0 in 0.069s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "1e8774bbadc3ff1634c173d64a83e5648c0b76b4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'migration_context' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<253d389a-0014-4ae6-a631-e401cf63a697> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start _get_guest_xml network_info=[{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:07:92:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8b9e549b-439b-4d3b-9e18-428ad8f46467', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '253d389a-0014-4ae6-a631-e401cf63a697', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0bdb232-84c0-4a6c-9340-1c9662232235', 'serial': 'c0bdb232-84c0-4a6c-9340-1c9662232235'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '79332d72-dbda-433e-a317-32ac1a8e788c', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<253d389a-0014-4ae6-a631-e401cf63a697> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'numa_topology' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<253d389a-0014-4ae6-a631-e401cf63a697> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:06:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'vcpu_model' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<253d389a-0014-4ae6-a631-e401cf63a697> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:06:36 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:06:36 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:06:36 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[36493632-c777-476b-8d4d-e0b4eb46a7fc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QJAkDPSv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 24 19:06:36 user nova-compute[75051]: node.name = iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:06:36 user nova-compute[75051]: node.tpgt = -1
Nov 24 19:06:36 user nova-compute[75051]: node.startup = automatic
Nov 24 19:06:36 user nova-compute[75051]: node.leading_login = No
Nov 24 19:06:36 user nova-compute[75051]: iface.iscsi_ifacename = default
Nov 24 19:06:36 user nova-compute[75051]: iface.net_ifacename = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.ipaddress = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.prefix_len = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.hwaddress = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.transport_name = tcp
Nov 24 19:06:36 user nova-compute[75051]: iface.initiatorname = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.vlan_id = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.vlan_priority = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.vlan_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.iface_num = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.mtu = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.port = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.bootproto = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.subnet_mask = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.gateway = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_alt_client_id_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_alt_client_id = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_dns = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_learn_iqn = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_req_vendor_id_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_vendor_id_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_vendor_id = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.dhcp_slp_da = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.fragmentation = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.gratuitous_arp = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.incoming_forwarding = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.tos_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.tos = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.ttl = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.delayed_ack = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.tcp_nagle = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.tcp_wsf_state = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.tcp_wsf = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.tcp_timer_scale = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.tcp_timestamp = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.redirect = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.def_task_mgmt_timeout = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.header_digest = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.data_digest = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.immediate_data = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.initial_r2t = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.data_seq_inorder = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.data_pdu_inorder = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.erl = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.max_receive_data_len = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.first_burst_len = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.max_outstanding_r2t = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.max_burst_len = 0
Nov 24 19:06:36 user nova-compute[75051]: iface.chap_auth = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.bidi_chap = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.strict_login_compliance = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.discovery_auth = <empty>
Nov 24 19:06:36 user nova-compute[75051]: iface.discovery_logout = <empty>
Nov 24 19:06:36 user nova-compute[75051]: node.discovery_address = <empty>
Nov 24 19:06:36 user nova-compute[75051]: node.discovery_port = 0
Nov 24 19:06:36 user nova-compute[75051]: node.discovery_type = static
Nov 24 19:06:36 user nova-compute[75051]: node.session.initial_cmdsn = 0
Nov 24 19:06:36 user nova-compute[75051]: node.session.initial_login_retry_max = 8
Nov 24 19:06:36 user nova-compute[75051]: node.session.xmit_thread_priority = -20
Nov 24 19:06:36 user nova-compute[75051]: node.session.cmds_max = 128
Nov 24 19:06:36 user nova-compute[75051]: node.session.queue_depth = 32
Nov 24 19:06:36 user nova-compute[75051]: node.session.nr_sessions = 1
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.authmethod = CHAP
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.username = QJAkDPSv
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.password = ***
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.username_in = <empty>
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.password_in = <empty>
Nov 24 19:06:36 user nova-compute[75051]: node.session.auth.chap_algs = MD5
Nov 24 19:06:36 user nova-compute[75051]: node.session.timeo.replacement_timeout = 120
Nov 24 19:06:36 user nova-compute[75051]: node.session.err_timeo.abort_timeout = 15
Nov 24 19:06:36 user nova-compute[75051]: node.session.err_timeo.lu_reset_timeout = 30
Nov 24 19:06:36 user nova-compute[75051]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 24 19:06:36 user nova-compute[75051]: node.session.err_timeo.host_reset_timeout = 60
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.FastAbort = Yes
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.InitialR2T = No
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.ImmediateData = Yes
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.FirstBurstLength = 262144
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.MaxBurstLength = 16776192
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.DefaultTime2Retain = 0
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.DefaultTime2Wait = 2
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.MaxConnections = 1
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 24 19:06:36 user nova-compute[75051]: node.session.iscsi.ERL = 0
Nov 24 19:06:36 user nova-compute[75051]: node.session.scan = manual
Nov 24 19:06:36 user nova-compute[75051]: node.session.reopen_max = 0
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].address = 172.16.0.220
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].port = 3260
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].startup = manual
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].tcp.window_size = 524288
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].tcp.type_of_service = 0
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].timeo.logout_timeout = 15
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].timeo.login_timeout = 15
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].timeo.auth_timeout = 45
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].timeo.noop_out_interval = 5
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].timeo.noop_out_timeout = 5
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.HeaderDigest = None
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.DataDigest = None
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.IFMarker = No
Nov 24 19:06:36 user nova-compute[75051]: node.conn[0].iscsi.OFMarker = No
Nov 24 19:06:36 user nova-compute[75051]: # END RECORD
Nov 24 19:06:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a40307-0b1c-4160-ad07-b52fc83829fc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9162a1-d73f-47ea-91e5-b48595d465e5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJAkDPSv {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJAkDPSv" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b2f168-a264-4523-96e9-d6fd51345dac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJAkDPSv'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b1e0d3-7504-4045-975e-c654dd7ad90c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[47110d3b-7a10-40d0-9701-024e64dfdd92]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:06:36 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:06:36 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:06:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:06:36 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:06:36 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:06:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22005dc-7db2-4ddf-a3cb-ddaab4f01604]: (4, ('0 0 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.158s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== connect_volume: return (160ms) {'type': 'block', 'scsi_wwn': '26263323064363934', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263323064363934', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-405124060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-405124060',id=27,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:04:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-b9vto5l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:05:00Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=253d389a-0014-4ae6-a631-e401cf63a697,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:07:92:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "vif_mac": "fa:16:3e:07:92:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'pci_devices' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.objects.base [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Object Instance<253d389a-0014-4ae6-a631-e401cf63a697> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:06:36 user nova-compute[75051]:   <uuid>253d389a-0014-4ae6-a631-e401cf63a697</uuid>
Nov 24 19:06:36 user nova-compute[75051]:   <name>instance-0000001b</name>
Nov 24 19:06:36 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:06:36 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:06:36 user nova-compute[75051]:   <metadata>
Nov 24 19:06:36 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:06:36 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-405124060</nova:name>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:06:36</nova:creationTime>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:06:36 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:06:36 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:owner>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:user uuid="88113529ca6747f281d4203c9c1d845f">tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member</nova:user>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:project uuid="1ae7be1d57e44aae8c9b5695bba53ef3">tempest-ServerBootFromVolumeStableRescueTest-1279504857</nova:project>
Nov 24 19:06:36 user nova-compute[75051]:       </nova:owner>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:06:36 user nova-compute[75051]:       <nova:ports>
Nov 24 19:06:36 user nova-compute[75051]:         <nova:port uuid="6ad7e0da-34a4-4320-aa92-08c512ee482d">
Nov 24 19:06:36 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:06:36 user nova-compute[75051]:         </nova:port>
Nov 24 19:06:36 user nova-compute[75051]:       </nova:ports>
Nov 24 19:06:36 user nova-compute[75051]:     </nova:instance>
Nov 24 19:06:36 user nova-compute[75051]:   </metadata>
Nov 24 19:06:36 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:06:36 user nova-compute[75051]:     <system>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="serial">253d389a-0014-4ae6-a631-e401cf63a697</entry>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="uuid">253d389a-0014-4ae6-a631-e401cf63a697</entry>
Nov 24 19:06:36 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:06:36 user nova-compute[75051]:     </system>
Nov 24 19:06:36 user nova-compute[75051]:   </sysinfo>
Nov 24 19:06:36 user nova-compute[75051]:   <os>
Nov 24 19:06:36 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:06:36 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:06:36 user nova-compute[75051]:   </os>
Nov 24 19:06:36 user nova-compute[75051]:   <features>
Nov 24 19:06:36 user nova-compute[75051]:     <acpi/>
Nov 24 19:06:36 user nova-compute[75051]:     <apic/>
Nov 24 19:06:36 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:06:36 user nova-compute[75051]:   </features>
Nov 24 19:06:36 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:06:36 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:06:36 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:06:36 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:06:36 user nova-compute[75051]:   </clock>
Nov 24 19:06:36 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:06:36 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:06:36 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:06:36 user nova-compute[75051]:   </cpu>
Nov 24 19:06:36 user nova-compute[75051]:   <devices>
Nov 24 19:06:36 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:06:36 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:06:36 user nova-compute[75051]:       <source dev="/dev/sdd"/>
Nov 24 19:06:36 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:06:36 user nova-compute[75051]:       <serial>c0bdb232-84c0-4a6c-9340-1c9662232235</serial>
Nov 24 19:06:36 user nova-compute[75051]:     </disk>
Nov 24 19:06:36 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:06:36 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:06:36 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue"/>
Nov 24 19:06:36 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:06:36 user nova-compute[75051]:       <boot order="1"/>
Nov 24 19:06:36 user nova-compute[75051]:     </disk>
Nov 24 19:06:36 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:06:36 user nova-compute[75051]:       <mac address="fa:16:3e:07:92:99"/>
Nov 24 19:06:36 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:36 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:06:36 user nova-compute[75051]:       <target dev="tap6ad7e0da-34"/>
Nov 24 19:06:36 user nova-compute[75051]:     </interface>
Nov 24 19:06:36 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:06:36 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/console.log" append="off"/>
Nov 24 19:06:36 user nova-compute[75051]:     </serial>
Nov 24 19:06:36 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:06:36 user nova-compute[75051]:     <video>
Nov 24 19:06:36 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:36 user nova-compute[75051]:     </video>
Nov 24 19:06:36 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:06:36 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:06:36 user nova-compute[75051]:     </rng>
Nov 24 19:06:36 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:06:36 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:06:36 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:06:36 user nova-compute[75051]:     </memballoon>
Nov 24 19:06:36 user nova-compute[75051]:   </devices>
Nov 24 19:06:36 user nova-compute[75051]: </domain>
Nov 24 19:06:36 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:06:36 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance destroyed successfully.
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] No VIF found with MAC fa:16:3e:07:92:99, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:06:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:38 user nova-compute[75051]: WARNING nova.compute.manager [req-7a774c0d-c0fb-4ef7-9268-d1cedffc3b71 req-3e05beb9-ddc7-496e-9407-2a834e53989f service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state rescuing.
Nov 24 19:06:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:40 user nova-compute[75051]: WARNING nova.compute.manager [req-560f5343-ff07-4ac5-ad36-32b7f51920e6 req-098f66f4-2643-497d-b65a-f61cd1f0abfb service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state rescuing.
Nov 24 19:06:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-50f251d8-e4fb-415c-a3bb-e441ded77328 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:06:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:06:48 user nova-compute[75051]: INFO nova.compute.claims [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Claim successful on node user
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:06:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.policy [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623c9f272b0e44f1a14364d1f90fc762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c07aa581fa647a39092777af5ee366d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:06:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Creating image(s)
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk 1073741824" returned: 0 in 0.054s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Successfully created port: 0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Cannot resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Ensure instance console log exists: /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Successfully updated port: 0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-changed-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Refreshing instance network info cache due to event network-changed-0930de9a-909c-4368-8b12-b7d3c8ee618f. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:06:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance network_info: |[{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Refreshing network info cache for port 0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start _get_guest_xml network_info=[{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:06:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:06:51 user nova-compute[75051]:   <uuid>0a4bd91d-ace4-41e5-a9e6-0dd291622b45</uuid>
Nov 24 19:06:51 user nova-compute[75051]:   <name>instance-0000001f</name>
Nov 24 19:06:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:06:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:06:51 user nova-compute[75051]:   <metadata>
Nov 24 19:06:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:06:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeTestJSON-server-1975778758</nova:name>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:06:51</nova:creationTime>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:06:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:06:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:owner>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:user uuid="623c9f272b0e44f1a14364d1f90fc762">tempest-AttachVolumeTestJSON-866610194-project-member</nova:user>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:project uuid="2c07aa581fa647a39092777af5ee366d">tempest-AttachVolumeTestJSON-866610194</nova:project>
Nov 24 19:06:51 user nova-compute[75051]:       </nova:owner>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:06:51 user nova-compute[75051]:       <nova:ports>
Nov 24 19:06:51 user nova-compute[75051]:         <nova:port uuid="0930de9a-909c-4368-8b12-b7d3c8ee618f">
Nov 24 19:06:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:06:51 user nova-compute[75051]:         </nova:port>
Nov 24 19:06:51 user nova-compute[75051]:       </nova:ports>
Nov 24 19:06:51 user nova-compute[75051]:     </nova:instance>
Nov 24 19:06:51 user nova-compute[75051]:   </metadata>
Nov 24 19:06:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:06:51 user nova-compute[75051]:     <system>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="serial">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="uuid">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:06:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:06:51 user nova-compute[75051]:     </system>
Nov 24 19:06:51 user nova-compute[75051]:   </sysinfo>
Nov 24 19:06:51 user nova-compute[75051]:   <os>
Nov 24 19:06:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:06:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:06:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:06:51 user nova-compute[75051]:   </os>
Nov 24 19:06:51 user nova-compute[75051]:   <features>
Nov 24 19:06:51 user nova-compute[75051]:     <acpi/>
Nov 24 19:06:51 user nova-compute[75051]:     <apic/>
Nov 24 19:06:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:06:51 user nova-compute[75051]:   </features>
Nov 24 19:06:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:06:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:06:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:06:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:06:51 user nova-compute[75051]:   </clock>
Nov 24 19:06:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:06:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:06:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:06:51 user nova-compute[75051]:   </cpu>
Nov 24 19:06:51 user nova-compute[75051]:   <devices>
Nov 24 19:06:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:06:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:06:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk"/>
Nov 24 19:06:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:06:51 user nova-compute[75051]:     </disk>
Nov 24 19:06:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:06:51 user nova-compute[75051]:       <mac address="fa:16:3e:24:4c:23"/>
Nov 24 19:06:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:06:51 user nova-compute[75051]:       <target dev="tap0930de9a-90"/>
Nov 24 19:06:51 user nova-compute[75051]:     </interface>
Nov 24 19:06:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:06:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/console.log" append="off"/>
Nov 24 19:06:51 user nova-compute[75051]:     </serial>
Nov 24 19:06:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:06:51 user nova-compute[75051]:     <video>
Nov 24 19:06:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:06:51 user nova-compute[75051]:     </video>
Nov 24 19:06:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:06:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:06:51 user nova-compute[75051]:     </rng>
Nov 24 19:06:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:06:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:06:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:06:51 user nova-compute[75051]:     </memballoon>
Nov 24 19:06:51 user nova-compute[75051]:   </devices>
Nov 24 19:06:51 user nova-compute[75051]: </domain>
Nov 24 19:06:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG os_vif [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ad121a9-3af1-50d2-bcb4-be901984de95', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0930de9a-90, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0930de9a-90, col_values=(('qos', UUID('2ace92af-8ca8-483e-9c1b-85c5cb92099e')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0930de9a-90, col_values=(('external_ids', {'iface-id': '0930de9a-909c-4368-8b12-b7d3c8ee618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:4c:23', 'vm-uuid': '0a4bd91d-ace4-41e5-a9e6-0dd291622b45'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:51 user nova-compute[75051]: INFO os_vif [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No VIF found with MAC fa:16:3e:24:4c:23, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updated VIF entry in instance network info cache for port 0930de9a-909c-4368-8b12-b7d3c8ee618f. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:06:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ff623930-a258-48cc-bb95-e08e1a7dbfb1 req-599f4925-c1e7-49c5-8871-bdfa4567b74b service nova] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:52 user nova-compute[75051]: WARNING nova.compute.manager [req-835610cc-5047-4e10-a639-c85660b52a09 req-408b1fc8-5d5f-4b4b-aaef-5cf067e9ab08 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state building and task_state spawning.
Nov 24 19:06:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:06:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance spawned successfully.
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:06:54 user nova-compute[75051]: INFO nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:06:54 user nova-compute[75051]: INFO nova.compute.manager [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Took 6.08 seconds to build instance.
Nov 24 19:06:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0196dbe2-c682-4ac1-a030-e14d6cf69436 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.193s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:06:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:06:54 user nova-compute[75051]: WARNING nova.compute.manager [req-09c4b909-9f7b-4951-9a60-5bf2033835d4 req-82484d1b-a398-4700-b362-02330ad89f5b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state active and task_state None.
Nov 24 19:06:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:06:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing instance network info cache due to event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updated VIF entry in instance network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3e48c198-85f6-476e-88ed-aa3e81b87a23 req-a377c4ef-fe5f-4757-ba5c-fa552c010bf2 service nova] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:02 user nova-compute[75051]: INFO nova.compute.manager [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Shelve offloading
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:03 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance destroyed successfully.
Nov 24 19:07:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:07:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:07:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:07:03 user nova-compute[75051]: DEBUG nova.network.neutron [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:07:03 user nova-compute[75051]: DEBUG nova.network.neutron [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:07:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:07:04 user nova-compute[75051]: WARNING nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state active and task_state shelving.
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:07:04 user nova-compute[75051]: WARNING nova.compute.manager [req-44993bc8-9bbd-460e-abdd-a9011d3d7de3 req-d210ff69-7583-4165-aded-5359caaa655b service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state active and task_state shelving.
Nov 24 19:07:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance destroyed successfully.
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'resources' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIipMsvh73b8rbg19gQpwcKIdPp+wX6vjE+/5Ty9em15V0xhsrgyyWosEe5+BheW5JFPEUyKwQh47zO/eSEM/CQNVCIcF1RmyGwC8E9sIlF40tbJKISmi1C3SwzsUlW+7g==',key_name='tempest-TestShelveInstance-1755056591',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:05:25Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_vif [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf63c6b52-10, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing instance network info cache due to event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.network.neutron [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a6a2932-663c-4aa9-b379-b2471ab2df5f) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:04 user nova-compute[75051]: INFO os_vif [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10')
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:07:04 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca6bd1-c4a2-4848-9ff0-47da66a77c2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:07:04 user nova-compute[75051]: No targets found.
Nov 24 19:07:04 user nova-compute[75051]: iSNS:
Nov 24 19:07:04 user nova-compute[75051]: No targets found.
Nov 24 19:07:04 user nova-compute[75051]: STATIC:
Nov 24 19:07:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:07:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:07:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:07:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:04 user nova-compute[75051]: FIRMWARE:
Nov 24 19:07:04 user nova-compute[75051]: No targets found.
Nov 24 19:07:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:07:04 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:07:04 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d97a7a-464b-43d9-b652-e8e01dea488d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[77500b1f-10c0-4c93-ab53-3faeec622ff8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:04 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:04 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:07:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:04 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:04 user nova-compute[75051]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:07:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0428430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bc75ae-053b-4305-9a6d-9c10411342b8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[758e362c-d610-4c9c-946f-9ac6d8d378e3]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb09b2-1eb3-4050-a268-23510916a231]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf537311-8cbc-4d2b-83ec-01c5b6fc3061]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c170794-55ed-4bfa-95bb-6a7632a021ba]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98b0b8-5dc8-464b-81df-a28ce5cdf719]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]
Nov 24 19:07:04 user nova-compute[75051]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.
Nov 24 19:07:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[948044c0-e176-40f3-b686-cf2b9c9db00e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== disconnect_volume: return (315ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:07:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deleting instance files /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225_del
Nov 24 19:07:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deletion of /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225_del complete
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.network.neutron [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updated VIF entry in instance network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG nova.network.neutron [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": null, "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf63c6b52-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:07:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ad30f057-0361-4f03-bb38-f790c6248c46 req-42ca59d0-c445-4105-8ab1-f02a298fc93e service nova] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:07:05 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Deleted allocations for instance 956f4b65-634b-4b22-b72c-d6df5ffff225
Nov 24 19:07:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'numa_topology' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG nova.objects.base [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Object Instance<956f4b65-634b-4b22-b72c-d6df5ffff225> lazy-loaded attributes: resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:07:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-433ddbc1-2917-4b8e-84e4-b73719e414f1 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.398s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:13 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:07:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:16 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.manager [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing instance network info cache due to event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] Acquiring lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] Acquired lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.network.neutron [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing network info cache for port 254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:07:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:07:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=7790MB free_disk=25.041671752929688GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 253d389a-0014-4ae6-a631-e401cf63a697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance cb2775e4-7c40-4e39-9be0-c9b992ef45f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.network.neutron [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updated VIF entry in instance network info cache for port 254bade7-a1f1-4197-ad8e-07e2928b81e5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG nova.network.neutron [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [{"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:07:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-796008b8-6244-4fae-bb71-ffc7ef4cdf80 req-d37e2b16-2c7f-4990-a7b3-762e1e3b23ca service nova] Releasing lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:21 user nova-compute[75051]: INFO nova.compute.manager [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Attaching volume 62d6ba84-047c-4858-88a8-5feba4fe56f5 to /dev/vdb
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.utils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[343627b8-efc7-489d-af71-9cd86dd737f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b01be96-aab8-48e5-bf3e-64eb13161855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dde86c2-c658-4bd0-9d06-a2a90190e110]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c937c6f-028e-4fd3-887c-ed050180870d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:07:21 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:07:21 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a7291-88db-4dcd-9905-ff77e620c5b0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG os_brick.utils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:07:21 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating existing volume attachment record: 8275a788-7bfd-4cde-a870-7bcc14504955 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:07:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:07:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZikXUlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:07:29 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:07:29 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:07:29 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd2db3-f622-4144-9aa9-a1c12aba853b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:07:29 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04c4763-047c-474e-bdd4-c57e2c5594ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5] added
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[61211dbf-4b73-4ab5-944c-f7843fd6ca8a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e8543-c537-49d6-897b-f1cc449d786f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZikXUlC {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SZikXUlC" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f40cca-80e1-452e-b3ff-2316289976ce]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SZikXUlC'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3692162-4299-4dfa-8dfa-1873082cb76c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b815a3f4-d15e-4e2c-a283-2fecd945ac90]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cfc42b-de94-4cbb-a5b5-7a27da48e8e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260]
Nov 24 19:07:29 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260] successful.
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a847ea70-8171-4868-8cc5-873e0c4e2101]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[754258bd-c412-422d-9a02-c5593c40a49b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)
Nov 24 19:07:29 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[853bdc92-ebb6-43d4-963c-b8fc0a67536e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZikXUlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23239663933376230', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239663933376230', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:07:30 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:07:30 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:07:30 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:07:30 user nova-compute[75051]:   <serial>62d6ba84-047c-4858-88a8-5feba4fe56f5</serial>
Nov 24 19:07:30 user nova-compute[75051]: </disk>
Nov 24 19:07:30 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:07:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] No VIF found with MAC fa:16:3e:1d:3a:2e, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:07:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bae28e1-59cd-4d4e-bd75-f8a74cf37a63 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.034s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:07:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:07:32 user nova-compute[75051]: INFO nova.compute.manager [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Detaching volume 62d6ba84-047c-4858-88a8-5feba4fe56f5
Nov 24 19:07:33 user nova-compute[75051]: INFO nova.virt.block_device [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Attempting to driver detach volume 62d6ba84-047c-4858-88a8-5feba4fe56f5 from mountpoint /dev/vdb
Nov 24 19:07:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Attempting to detach device vdb from instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:07:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:07:33 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:07:33 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:07:33 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:07:33 user nova-compute[75051]:   <serial>62d6ba84-047c-4858-88a8-5feba4fe56f5</serial>
Nov 24 19:07:33 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:07:33 user nova-compute[75051]: </disk>
Nov 24 19:07:33 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:07:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully detached device vdb from instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 from the persistent domain config.
Nov 24 19:07:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:07:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:07:33 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:07:33 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:07:33 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:07:33 user nova-compute[75051]:   <serial>62d6ba84-047c-4858-88a8-5feba4fe56f5</serial>
Nov 24 19:07:33 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:07:33 user nova-compute[75051]: </disk>
Nov 24 19:07:33 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:07:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:07:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:07:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:53 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 is timed out.
Nov 24 19:07:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully detached device vdb from instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 from the live domain config.
Nov 24 19:07:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SZikXUlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:07:53 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0761f3c4-5fe6-4210-8d17-109cde5b8626]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:07:53 user nova-compute[75051]: No targets found.
Nov 24 19:07:53 user nova-compute[75051]: iSNS:
Nov 24 19:07:53 user nova-compute[75051]: No targets found.
Nov 24 19:07:53 user nova-compute[75051]: STATIC:
Nov 24 19:07:53 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:07:53 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:53 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:53 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:07:53 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:53 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:53 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5
Nov 24 19:07:53 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:07:53 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:07:53 user nova-compute[75051]: FIRMWARE:
Nov 24 19:07:53 user nova-compute[75051]: No targets found.
Nov 24 19:07:53 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:07:53 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:07:53 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755947d-9793-4f14-acc9-a50706140e0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e7654-72d5-4d6f-bdff-b25b8cac17bb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 (non-flash)
Nov 24 19:07:53 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0428dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f8e291-4b45-4825-8e81-43972f4d05a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ecf6c-0941-4677-aa91-fe3a3dc2e8ea]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eed97c5-dcee-4115-8ded-6abc5d5133c5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc70c9-0702-454a-920e-4fdb936b50cb]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b11a3-54e7-4638-a3a1-411017f0bb78]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b613b89-247c-498b-9b29-c6320a7999ef]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260]
Nov 24 19:07:53 user nova-compute[75051]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5, portal: 172.16.0.220,3260] successful.
Nov 24 19:07:53 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62d6ba84-047c-4858-88a8-5feba4fe56f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef869e48-6e55-4331-94b1-8aae3e5a50f4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] <== disconnect_volume: return (293ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:07:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:07:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:07:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'flavor' on Instance uuid d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:07:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ba7c45ec-3542-4ff7-8db0-ed6409397883 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.646s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:07:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:01 user nova-compute[75051]: INFO nova.compute.manager [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Terminating instance
Nov 24 19:08:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-unplugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-unplugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d457d1-d90e-4eb0-bc96-7e3ceede3bce req-962af372-3d1a-4b7b-a3c8-4a3aaafcc020 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-unplugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:08:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Instance destroyed successfully.
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lazy-loading 'resources' on Instance uuid cb2775e4-7c40-4e39-9be0-c9b992ef45f1 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-67374235',display_name='tempest-VolumesActionsTest-instance-67374235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-67374235',id=30,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8077e9c3a9ab404ba79b2d569a4f30db',ramdisk_id='',reservation_id='r-jgp3bu9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2104762263',owner_user_name='tempest-VolumesActionsTest-2104762263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:06:17Z,user_data=None,user_id='c951d62f40724a90b384adb0365e53eb',uuid=cb2775e4-7c40-4e39-9be0-c9b992ef45f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converting VIF {"id": "2166f78c-a675-409f-a2ff-092b21b32fef", "address": "fa:16:3e:10:e9:32", "network": {"id": "a3ee90bf-94e3-4a00-bbde-9a79748e2af8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-390336148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8077e9c3a9ab404ba79b2d569a4f30db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2166f78c-a6", "ovs_interfaceid": "2166f78c-a675-409f-a2ff-092b21b32fef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG os_vif [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2166f78c-a6, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9787393-c7d6-4f2e-a371-069267063f92) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: INFO os_vif [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e9:32,bridge_name='br-int',has_traffic_filtering=True,id=2166f78c-a675-409f-a2ff-092b21b32fef,network=Network(a3ee90bf-94e3-4a00-bbde-9a79748e2af8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2166f78c-a6')
Nov 24 19:08:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Deleting instance files /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1_del
Nov 24 19:08:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Deletion of /opt/stack/data/nova/instances/cb2775e4-7c40-4e39-9be0-c9b992ef45f1_del complete
Nov 24 19:08:02 user nova-compute[75051]: INFO nova.compute.manager [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 24 19:08:02 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:02 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Took 0.73 seconds to deallocate network for instance.
Nov 24 19:08:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Deleted allocations for instance cb2775e4-7c40-4e39-9be0-c9b992ef45f1
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-051b7a1a-c99e-4541-9258-e8d544eceaf6 tempest-VolumesActionsTest-2104762263 tempest-VolumesActionsTest-2104762263-project-member] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:03 user nova-compute[75051]: WARNING nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state deleted and task_state None.
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:03 user nova-compute[75051]: WARNING nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state deleted and task_state None.
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:03 user nova-compute[75051]: WARNING nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state deleted and task_state None.
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Acquiring lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] Lock "cb2775e4-7c40-4e39-9be0-c9b992ef45f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] No waiting events found dispatching network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:03 user nova-compute[75051]: WARNING nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received unexpected event network-vif-plugged-2166f78c-a675-409f-a2ff-092b21b32fef for instance with vm_state deleted and task_state None.
Nov 24 19:08:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-5706d1b0-f391-47ab-b2b0-73bcf655fda1 req-e483eacf-6551-41d0-8ca0-44c908a89cf8 service nova] [instance: cb2775e4-7c40-4e39-9be0-c9b992ef45f1] Received event network-vif-deleted-2166f78c-a675-409f-a2ff-092b21b32fef {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:08:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:08:19 user nova-compute[75051]: INFO nova.compute.claims [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Claim successful on node user
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:08:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:08:20 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.policy [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1542a899903c40dfba0d4b274b547b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae5e7665a994fe29c206c1b53c5359f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:08:20 user nova-compute[75051]: INFO nova.virt.block_device [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Booting with volume 685790db-ad8b-4088-9115-3e0e64273dff at /dev/vda
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.utils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d210180-98df-4942-aa75-75023f4723c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d3160-2780-48ed-a15c-f601f3b00151]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6669f381-b977-47ad-85ed-434353760675]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60b1f5f-ca7a-4e97-9d13-913179805e86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:20 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b55381-a321-43cc-859c-5d0b776f1027]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG os_brick.utils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating existing volume attachment record: 2f33621c-4a74-4057-b187-46d6ec6f2664 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Successfully created port: 64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:08:21 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:08:21 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8136MB free_disk=25.067298889160156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 253d389a-0014-4ae6-a631-e401cf63a697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:08:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Successfully updated port: 64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-changed-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Refreshing instance network info cache due to event network-changed-64c1e144-62f9-4d97-96fb-1ab66a6016e5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance network_info: |[{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Refreshing network info cache for port 64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updated VIF entry in instance network info cache for port 64c1e144-62f9-4d97-96fb-1ab66a6016e5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bdd279d0-ef69-4546-8e5d-6f824a29f5fa req-5b31acf3-a4f7-4961-9ffe-e48a402725a8 service nova] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:23 user nova-compute[75051]: INFO nova.compute.manager [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Unrescuing
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquired lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing instance network info cache due to event network-changed-254bade7-a1f1-4197-ad8e-07e2928b81e5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] Acquiring lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] Acquired lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Refreshing network info cache for port 254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:23 user nova-compute[75051]: INFO nova.compute.manager [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Terminating instance
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Releasing lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'flavor' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updated VIF entry in instance network info cache for port 254bade7-a1f1-4197-ad8e-07e2928b81e5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [{"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-38ee37da-50a5-4c6a-95e3-8bd35ef1180f req-23452439-ae83-4c65-9a97-a885f76c7e2d service nova] Releasing lock "refresh_cache-d82b90d0-83ce-4c6d-b345-6011c8e2dc24" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Instance destroyed successfully.
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.objects.instance [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'resources' on Instance uuid d82b90d0-83ce-4c6d-b345-6011c8e2dc24 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:05:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-68209113',display_name='tempest-TestStampPattern-server-68209113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-68209113',id=29,image_ref='da4c79e3-07d2-4a31-826f-3c4f82226728',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:05:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-ph9n6pf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a26aa8a-384a-4bb2-9952-61724355bee8',image_min_disk='1',image_min_ram='0',image_owner_id='a8060f2b760f4074b5a6827102cdb518',image_owner_project_name='tempest-TestStampPattern-1820980037',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1820980037-project-member',image_user_id='d837fbd543a9418d9c4e130bd2250a09',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:05:36Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=d82b90d0-83ce-4c6d-b345-6011c8e2dc24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "address": "fa:16:3e:1d:3a:2e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254bade7-a1", "ovs_interfaceid": "254bade7-a1f1-4197-ad8e-07e2928b81e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG os_vif [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254bade7-a1, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance destroyed successfully.
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=340ca852-9e02-45ae-bfca-7f6e0b9a7922) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:24 user nova-compute[75051]: INFO os_vif [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:3a:2e,bridge_name='br-int',has_traffic_filtering=True,id=254bade7-a1f1-4197-ad8e-07e2928b81e5,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254bade7-a1')
Nov 24 19:08:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Deleting instance files /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24_del
Nov 24 19:08:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Deletion of /opt/stack/data/nova/instances/d82b90d0-83ce-4c6d-b345-6011c8e2dc24_del complete
Nov 24 19:08:25 user nova-compute[75051]: INFO nova.compute.manager [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:25 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Took 0.46 seconds to deallocate network for instance.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d621410e-34c1-41f3-accd-8bb29a909771 req-10d763b1-3348-4ed9-b6fa-983762e62650 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-deleted-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: INFO nova.compute.manager [req-d621410e-34c1-41f3-accd-8bb29a909771 req-10d763b1-3348-4ed9-b6fa-983762e62650 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Neutron deleted interface 254bade7-a1f1-4197-ad8e-07e2928b81e5; detaching it from the instance and deleting it from the info cache
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-d621410e-34c1-41f3-accd-8bb29a909771 req-10d763b1-3348-4ed9-b6fa-983762e62650 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-d621410e-34c1-41f3-accd-8bb29a909771 req-10d763b1-3348-4ed9-b6fa-983762e62650 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Detach interface failed, port_id=254bade7-a1f1-4197-ad8e-07e2928b81e5, reason: Instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updating instance_info_cache with network_info: [{"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-unplugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-unplugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-unplugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state deleted and task_state None.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state deleted and task_state None.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state deleted and task_state None.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state deleted and task_state None.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Acquiring lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] No waiting events found dispatching network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:25 user nova-compute[75051]: WARNING nova.compute.manager [req-9b94003c-2ed2-4547-b3c9-d93d49992b9a req-4d041ea4-a905-467e-aaaf-2a586202fd62 service nova] [instance: d82b90d0-83ce-4c6d-b345-6011c8e2dc24] Received unexpected event network-vif-plugged-254bade7-a1f1-4197-ad8e-07e2928b81e5 for instance with vm_state deleted and task_state None.
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:25 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Deleted allocations for instance d82b90d0-83ce-4c6d-b345-6011c8e2dc24
Nov 24 19:08:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-22e45f33-828c-4ea0-b3db-7eee8737edfc tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "d82b90d0-83ce-4c6d-b345-6011c8e2dc24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:08:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Creating image(s)
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Ensure instance console log exists: /opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start _get_guest_xml network_info=[{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a9e43fd-eda8-4d2c-aa58-555dafb1a58e', 'attached_at': '', 'detached_at': '', 'volume_id': '685790db-ad8b-4088-9115-3e0e64273dff', 'serial': '685790db-ad8b-4088-9115-3e0e64273dff'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2f33621c-4a74-4057-b187-46d6ec6f2664', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:08:26 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:08:26 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:08:26 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:08:27 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:08:27 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:08:27 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5f1679-ab9a-444b-ad90-d250d270f408]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:08:27 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f1102-fb3f-4f30-b1b8-fac0bb2ef50c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff] added
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae8c0c-4880-4a88-9b34-109d02bc898d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6ff12-256d-4815-beee-1404f10bf081]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGoPvXQC {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGoPvXQC" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90fabb-2d76-47fd-b118-573f57da9846]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGoPvXQC'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6c3c2-1fcb-4cf2-8051-5abddb5d7f78]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae55f1c-fc0a-4d9c-8ccb-3a8ecda84ae5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea246933-7326-4fae-aa9d-526f49d11d95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]
Nov 24 19:08:27 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe24e1-ab29-4eae-a3e4-6f0dbb7a55e0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be565ea2-d448-4bff-b0ab-a8fbf547d13d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:27 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:27 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab53840-c396-4fc0-b5fb-ee0eabe2efce]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:27 user nova-compute[75051]: WARNING nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:27 user nova-compute[75051]: WARNING nova.compute.manager [req-8b515ea6-801e-4153-9be7-ada42086c230 req-2a409567-8164-4e39-8a70-104f8f237607 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-18e77135-6a53-4c03-945b-da46dcb5e844 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26333396266613731', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333396266613731', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:08:28 user nova-compute[75051]:   <uuid>6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</uuid>
Nov 24 19:08:28 user nova-compute[75051]:   <name>instance-00000020</name>
Nov 24 19:08:28 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:08:28 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:08:28 user nova-compute[75051]:   <metadata>
Nov 24 19:08:28 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:08:28 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:08:28 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherA-server-271988235</nova:name>
Nov 24 19:08:28 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:08:26</nova:creationTime>
Nov 24 19:08:28 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:08:28 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:08:28 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:08:28 user nova-compute[75051]:       <nova:owner>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:user uuid="1542a899903c40dfba0d4b274b547b73">tempest-ServerActionsTestOtherA-214702841-project-member</nova:user>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:project uuid="9ae5e7665a994fe29c206c1b53c5359f">tempest-ServerActionsTestOtherA-214702841</nova:project>
Nov 24 19:08:28 user nova-compute[75051]:       </nova:owner>
Nov 24 19:08:28 user nova-compute[75051]:       <nova:ports>
Nov 24 19:08:28 user nova-compute[75051]:         <nova:port uuid="64c1e144-62f9-4d97-96fb-1ab66a6016e5">
Nov 24 19:08:28 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:08:28 user nova-compute[75051]:         </nova:port>
Nov 24 19:08:28 user nova-compute[75051]:       </nova:ports>
Nov 24 19:08:28 user nova-compute[75051]:     </nova:instance>
Nov 24 19:08:28 user nova-compute[75051]:   </metadata>
Nov 24 19:08:28 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:08:28 user nova-compute[75051]:     <system>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="serial">6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</entry>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="uuid">6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</entry>
Nov 24 19:08:28 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:08:28 user nova-compute[75051]:     </system>
Nov 24 19:08:28 user nova-compute[75051]:   </sysinfo>
Nov 24 19:08:28 user nova-compute[75051]:   <os>
Nov 24 19:08:28 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:08:28 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:08:28 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:08:28 user nova-compute[75051]:   </os>
Nov 24 19:08:28 user nova-compute[75051]:   <features>
Nov 24 19:08:28 user nova-compute[75051]:     <acpi/>
Nov 24 19:08:28 user nova-compute[75051]:     <apic/>
Nov 24 19:08:28 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:08:28 user nova-compute[75051]:   </features>
Nov 24 19:08:28 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:08:28 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:08:28 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:08:28 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:08:28 user nova-compute[75051]:   </clock>
Nov 24 19:08:28 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:08:28 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:08:28 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:08:28 user nova-compute[75051]:   </cpu>
Nov 24 19:08:28 user nova-compute[75051]:   <devices>
Nov 24 19:08:28 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:08:28 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:08:28 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:08:28 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:08:28 user nova-compute[75051]:       <serial>685790db-ad8b-4088-9115-3e0e64273dff</serial>
Nov 24 19:08:28 user nova-compute[75051]:     </disk>
Nov 24 19:08:28 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:08:28 user nova-compute[75051]:       <mac address="fa:16:3e:9b:6e:8a"/>
Nov 24 19:08:28 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:08:28 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:08:28 user nova-compute[75051]:       <target dev="tap64c1e144-62"/>
Nov 24 19:08:28 user nova-compute[75051]:     </interface>
Nov 24 19:08:28 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:08:28 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e/console.log" append="off"/>
Nov 24 19:08:28 user nova-compute[75051]:     </serial>
Nov 24 19:08:28 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:08:28 user nova-compute[75051]:     <video>
Nov 24 19:08:28 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:08:28 user nova-compute[75051]:     </video>
Nov 24 19:08:28 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:08:28 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:08:28 user nova-compute[75051]:     </rng>
Nov 24 19:08:28 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:08:28 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:08:28 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:08:28 user nova-compute[75051]:     </memballoon>
Nov 24 19:08:28 user nova-compute[75051]:   </devices>
Nov 24 19:08:28 user nova-compute[75051]: </domain>
Nov 24 19:08:28 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG os_vif [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1a9a428-976b-5458-85b4-deffaa0f7151', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c1e144-62, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c1e144-62, col_values=(('qos', UUID('0f30be09-6173-4d41-9caa-c6b3d3178ab2')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c1e144-62, col_values=(('external_ids', {'iface-id': '64c1e144-62f9-4d97-96fb-1ab66a6016e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:6e:8a', 'vm-uuid': '6a9e43fd-eda8-4d2c-aa58-555dafb1a58e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:28 user nova-compute[75051]: INFO os_vif [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62')
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:08:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:9b:6e:8a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:29 user nova-compute[75051]: WARNING nova.compute.manager [req-032e4d7a-7d59-49c6-8036-d0b4f999e3b8 req-a3073d67-c071-40d7-b84a-7cafd40f3b57 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state building and task_state spawning.
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:08:31 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance spawned successfully.
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:08:31 user nova-compute[75051]: INFO nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 24 19:08:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:08:32 user nova-compute[75051]: INFO nova.compute.manager [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Took 12.71 seconds to build instance.
Nov 24 19:08:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3c29affa-67cf-43bc-a110-00a7062d03e9 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.847s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:32 user nova-compute[75051]: WARNING nova.compute.manager [req-6e8e2204-c9c4-4741-8d62-a85b210a59b1 req-3dc88513-460b-421b-8919-1f2b51c9b1ad service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state active and task_state None.
Nov 24 19:08:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-changed-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Refreshing instance network info cache due to event network-changed-0930de9a-909c-4368-8b12-b7d3c8ee618f. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:08:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:08:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:08:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Refreshing network info cache for port 0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:08:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updated VIF entry in instance network info cache for port 0930de9a-909c-4368-8b12-b7d3c8ee618f. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:08:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:08:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc3c9f33-03e9-4901-b5a0-f6be44c842a6 req-cc100ae7-a14d-4457-a1ab-4d9e4224601f service nova] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:08:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:43 user nova-compute[75051]: INFO nova.compute.manager [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Attaching volume e909bbea-d5af-4339-b21b-5893d064f615 to /dev/vdb
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.utils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d11c4-29a4-4197-b5f5-2ce51d668665]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe2211-d5f0-442b-9c36-c1a8230e9c28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5e233-5a7b-4913-953f-aeeaac3bb2ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93ec3c-e75e-48aa-8686-76119cb9b4aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:44 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:08:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05597176-7db4-408c-9061-2753aa12b240]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG os_brick.utils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:08:44 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating existing volume attachment record: 0678e724-0c5f-4a45-99fd-9e32bd71657a {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:08:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f059e874-6d1f-436c-a798-94426b9d6490" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "253d389a-0014-4ae6-a631-e401cf63a697" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "f059e874-6d1f-436c-a798-94426b9d6490" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "253d389a-0014-4ae6-a631-e401cf63a697" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:08:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:08:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:08:50 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ca262-687c-4b1c-b2e7-b4994049aa5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:08:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2715b273-efae-472e-aaf7-b96170ec1785]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615] added
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f00040-4d5b-4316-921f-ce732742bb93]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbcc719-ffa4-4189-bc8d-5e5752c7d7fb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqVXkFlZ {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqVXkFlZ" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a486a1-c152-4e2c-bc61-32ec0cd021e6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqVXkFlZ'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e688a6c-d6ea-4dac-ab28-aaaf8a76edf4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ecaf1-834f-48a6-a18f-d03ef4f98b62]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b91091-77f4-4f2e-8027-64e48e70cec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]
Nov 24 19:08:50 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[deffd783-caf4-4fc8-94df-0a722d46fa06]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76503d-2eae-404b-bfa3-11282d9636de]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:08:50 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:08:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba99fd9-39dc-4605-acdb-d4a830f9d9bb]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:08:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:08:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:08:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23734383430643938', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:08:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383430643938', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:08:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:08:51 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:08:51 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 19:08:51 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:08:51 user nova-compute[75051]:   <serial>e909bbea-d5af-4339-b21b-5893d064f615</serial>
Nov 24 19:08:51 user nova-compute[75051]: </disk>
Nov 24 19:08:51 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No VIF found with MAC fa:16:3e:24:4c:23, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77874b52-e2da-4b79-b5d2-8254356bac2b tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.347s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.319s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75051) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:53 user nova-compute[75051]: WARNING nova.compute.manager [req-6995d671-0d17-4bd7-bc33-4f113377cff3 req-012f5ba9-3b2c-4e02-be83-3f0d621f32e6 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state active and task_state powering-off.
Nov 24 19:08:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance destroyed successfully.
Nov 24 19:08:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:08:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3fb5bac3-0155-409d-bfc1-685b84d0783d tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.924s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:54 user nova-compute[75051]: INFO nova.compute.manager [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Unshelving
Nov 24 19:08:54 user nova-compute[75051]: INFO nova.virt.block_device [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Booting with volume 9097e29f-8904-4b62-ba38-57b50ee5ea9d at /dev/vda
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.utils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[618edfb8-7048-4748-9566-0a795fa83b4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca2e0f-55ce-447f-b832-0591d87eeefa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbd60e-76a3-4b1f-8c22-62ead707846e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1032511a-bfc1-49d7-bd0f-2843457c7133]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:08:54 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:08:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825bf2a-5df1-4aa4-a2b5-c161a3f24f30]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG os_brick.utils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:08:54 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating existing volume attachment record: 63d72c96-0bf1-480d-a5ac-d2639470178a {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:08:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:08:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:08:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:08:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:08:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:08:55 user nova-compute[75051]: WARNING nova.compute.manager [req-a1c35cee-3cfd-4569-931c-5c927589ad29 req-daee6de2-65e3-4b56-b7e7-973db695a477 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state stopped and task_state None.
Nov 24 19:08:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:08:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'pci_requests' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'numa_topology' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:09:01 user nova-compute[75051]: INFO nova.compute.claims [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Claim successful on node user
Nov 24 19:09:01 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:09:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:01 user nova-compute[75051]: INFO nova.network.neutron [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating port f63c6b52-105f-4f6a-a33e-1450d9a99d6e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing instance network info cache due to event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:09:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Creating image(s)
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Ensure instance console log exists: /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start _get_guest_xml network_info=[{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '956f4b65-634b-4b22-b72c-d6df5ffff225', 'attached_at': '', 'detached_at': '', 'volume_id': '9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'serial': '9097e29f-8904-4b62-ba38-57b50ee5ea9d'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '63d72c96-0bf1-480d-a5ac-d2639470178a', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.network.neutron [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:09:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'vcpu_model' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.objects.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Object Instance<956f4b65-634b-4b22-b72c-d6df5ffff225> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:09:02 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:09:02 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:09:02 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb2edef-8845-4fda-bcf1-32d66e274d2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:09:02 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec346c6-6ab8-4e4c-bb87-70b159764b58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d] added
Nov 24 19:09:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad12248b-8e4e-4894-af16-26c42bcc3a1e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e9415-dbb3-4091-a76f-bc5d076adf56]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqfnUrMG {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqfnUrMG" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0fc9cd-f768-4286-917c-dc60e85ea9ef]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqfnUrMG'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf96f7-f56e-40ec-b952-eb9ee2c8c4f6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f78ed-d733-4649-ae1f-d5535cb9406a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)
Nov 24 19:09:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:09:02 user nova-compute[75051]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)
Nov 24 19:09:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:09:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafb868d-0e31-4a02-a145-2f449c68597a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]
Nov 24 19:09:03 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.
Nov 24 19:09:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1766d8f-71f1-4867-8a0a-179d9acf616f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a055c-cac3-40a9-ad50-b6fbd57cb0b6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:09:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de67e9d8-3813-419d-a2c5-92573a77963c (non-flash)
Nov 24 19:09:03 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:09:03 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG nova.network.neutron [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updated VIF entry in instance network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG nova.network.neutron [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be51ad-dae2-40ab-8879-6adc2728cbf4]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd023d1b-22cb-4688-adce-34256e93e413 req-12656195-9435-44eb-b493-350397d11a23 service nova] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26166633531383062', 'path': '/dev/sdg'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166633531383062', 'path': '/dev/sdg'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1755056591',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:08:55Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'pci_devices' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.objects.base [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Object Instance<956f4b65-634b-4b22-b72c-d6df5ffff225> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:09:04 user nova-compute[75051]:   <uuid>956f4b65-634b-4b22-b72c-d6df5ffff225</uuid>
Nov 24 19:09:04 user nova-compute[75051]:   <name>instance-0000001c</name>
Nov 24 19:09:04 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:09:04 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:09:04 user nova-compute[75051]:   <metadata>
Nov 24 19:09:04 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:09:04 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:09:04 user nova-compute[75051]:       <nova:name>tempest-TestShelveInstance-server-905072644</nova:name>
Nov 24 19:09:04 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:09:02</nova:creationTime>
Nov 24 19:09:04 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:09:04 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:09:04 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:09:04 user nova-compute[75051]:       <nova:owner>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:user uuid="f06e00e20a4e41e4937e491f5c040ce8">tempest-TestShelveInstance-1748776926-project-member</nova:user>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:project uuid="8b5db41f7d844d1fb6359146dc69065e">tempest-TestShelveInstance-1748776926</nova:project>
Nov 24 19:09:04 user nova-compute[75051]:       </nova:owner>
Nov 24 19:09:04 user nova-compute[75051]:       <nova:ports>
Nov 24 19:09:04 user nova-compute[75051]:         <nova:port uuid="f63c6b52-105f-4f6a-a33e-1450d9a99d6e">
Nov 24 19:09:04 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 19:09:04 user nova-compute[75051]:         </nova:port>
Nov 24 19:09:04 user nova-compute[75051]:       </nova:ports>
Nov 24 19:09:04 user nova-compute[75051]:     </nova:instance>
Nov 24 19:09:04 user nova-compute[75051]:   </metadata>
Nov 24 19:09:04 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:09:04 user nova-compute[75051]:     <system>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="serial">956f4b65-634b-4b22-b72c-d6df5ffff225</entry>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="uuid">956f4b65-634b-4b22-b72c-d6df5ffff225</entry>
Nov 24 19:09:04 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:09:04 user nova-compute[75051]:     </system>
Nov 24 19:09:04 user nova-compute[75051]:   </sysinfo>
Nov 24 19:09:04 user nova-compute[75051]:   <os>
Nov 24 19:09:04 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:09:04 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:09:04 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:09:04 user nova-compute[75051]:   </os>
Nov 24 19:09:04 user nova-compute[75051]:   <features>
Nov 24 19:09:04 user nova-compute[75051]:     <acpi/>
Nov 24 19:09:04 user nova-compute[75051]:     <apic/>
Nov 24 19:09:04 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:09:04 user nova-compute[75051]:   </features>
Nov 24 19:09:04 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:09:04 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:09:04 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:09:04 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:09:04 user nova-compute[75051]:   </clock>
Nov 24 19:09:04 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:09:04 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:09:04 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:09:04 user nova-compute[75051]:   </cpu>
Nov 24 19:09:04 user nova-compute[75051]:   <devices>
Nov 24 19:09:04 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:09:04 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:09:04 user nova-compute[75051]:       <source dev="/dev/sdg"/>
Nov 24 19:09:04 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:09:04 user nova-compute[75051]:       <serial>9097e29f-8904-4b62-ba38-57b50ee5ea9d</serial>
Nov 24 19:09:04 user nova-compute[75051]:     </disk>
Nov 24 19:09:04 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:09:04 user nova-compute[75051]:       <mac address="fa:16:3e:35:bf:dd"/>
Nov 24 19:09:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:09:04 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:09:04 user nova-compute[75051]:       <target dev="tapf63c6b52-10"/>
Nov 24 19:09:04 user nova-compute[75051]:     </interface>
Nov 24 19:09:04 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:09:04 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225/console.log" append="off"/>
Nov 24 19:09:04 user nova-compute[75051]:     </serial>
Nov 24 19:09:04 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:09:04 user nova-compute[75051]:     <video>
Nov 24 19:09:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:09:04 user nova-compute[75051]:     </video>
Nov 24 19:09:04 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:09:04 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:09:04 user nova-compute[75051]:     </rng>
Nov 24 19:09:04 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:09:04 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:09:04 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:09:04 user nova-compute[75051]:     </memballoon>
Nov 24 19:09:04 user nova-compute[75051]:   </devices>
Nov 24 19:09:04 user nova-compute[75051]: </domain>
Nov 24 19:09:04 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1755056591',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:08:55Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG os_vif [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adeee833-e0b4-507e-af73-a76885cb6b19', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf63c6b52-10, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf63c6b52-10, col_values=(('qos', UUID('2efd073e-3111-4a26-bfe6-c3b3d298b4b2')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf63c6b52-10, col_values=(('external_ids', {'iface-id': 'f63c6b52-105f-4f6a-a33e-1450d9a99d6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:bf:dd', 'vm-uuid': '956f4b65-634b-4b22-b72c-d6df5ffff225'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:04 user nova-compute[75051]: INFO os_vif [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10')
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:09:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] No VIF found with MAC fa:16:3e:35:bf:dd, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:05 user nova-compute[75051]: WARNING nova.compute.manager [req-6a6c59a3-9e91-472d-80b2-003f9b92b27c req-fbd0b228-f0d2-4a84-9ffb-507bb90eabd7 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 19:09:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:09:07 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance spawned successfully.
Nov 24 19:09:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f0178af3-7890-4e4b-97a0-f268f5f63d91 tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.286s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:07 user nova-compute[75051]: WARNING nova.compute.manager [req-564ba2af-98c8-42aa-b264-e0c20409e26e req-b1edc798-2b07-4f00-adcc-1a3dabfa90fd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state active and task_state None.
Nov 24 19:09:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:09:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:09:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=24.155406951904297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a26aa8a-384a-4bb2-9952-61724355bee8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 253d389a-0014-4ae6-a631-e401cf63a697 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 956f4b65-634b-4b22-b72c-d6df5ffff225 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:09:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing instance network info cache due to event network-changed-db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] Acquiring lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] Acquired lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:21 user nova-compute[75051]: DEBUG nova.network.neutron [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Refreshing network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:22 user nova-compute[75051]: INFO nova.compute.manager [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Terminating instance
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updated VIF entry in instance network info cache for port db6ce854-31dd-4987-b595-1a5d9cbfdd1d. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.network.neutron [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating instance_info_cache with network_info: [{"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6d938d52-0887-47b4-a4cb-f375e41c4a5b req-b204ccf4-6f4d-4ce2-bda8-0be552930d6b service nova] Releasing lock "refresh_cache-0a26aa8a-384a-4bb2-9952-61724355bee8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-unplugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] No waiting events found dispatching network-vif-unplugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:22 user nova-compute[75051]: DEBUG nova.compute.manager [req-3673fa81-0e7f-46ab-8c60-cfb80d8821ae req-5edfb607-49cc-405e-8ede-3c379f32b32c service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-unplugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Instance destroyed successfully.
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lazy-loading 'resources' on Instance uuid 0a26aa8a-384a-4bb2-9952-61724355bee8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:02:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1460718531',display_name='tempest-TestStampPattern-server-1460718531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1460718531',id=25,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS2Yz5Srvh4JfXokhdjgv2NqmSK3s5u5j3S3xm/dSWUyWLiYPBvjLBlgPg6mpTqllUezUdYz19aTFABHnKb6jSX1uM01cMrH3A+9/ieY58rU6pNRbjUsAzeY9dEnFd6qA==',key_name='tempest-TestStampPattern-804351963',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:02:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8060f2b760f4074b5a6827102cdb518',ramdisk_id='',reservation_id='r-cejhrior',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1820980037',owner_user_name='tempest-TestStampPattern-1820980037-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:05:26Z,user_data=None,user_id='d837fbd543a9418d9c4e130bd2250a09',uuid=0a26aa8a-384a-4bb2-9952-61724355bee8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converting VIF {"id": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "address": "fa:16:3e:65:d0:7e", "network": {"id": "26fbde98-6f92-4e23-b897-82d6d813f44c", "bridge": "br-int", "label": "tempest-TestStampPattern-1503757668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8060f2b760f4074b5a6827102cdb518", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb6ce854-31", "ovs_interfaceid": "db6ce854-31dd-4987-b595-1a5d9cbfdd1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG os_vif [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb6ce854-31, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82db9061-f5e1-46c3-a736-6e063b7b0ed7) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:23 user nova-compute[75051]: INFO os_vif [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:d0:7e,bridge_name='br-int',has_traffic_filtering=True,id=db6ce854-31dd-4987-b595-1a5d9cbfdd1d,network=Network(26fbde98-6f92-4e23-b897-82d6d813f44c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb6ce854-31')
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Deleting instance files /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8_del
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Deletion of /opt/stack/data/nova/instances/0a26aa8a-384a-4bb2-9952-61724355bee8_del complete
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.compute.manager [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 24 19:09:23 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Took 0.42 seconds to deallocate network for instance.
Nov 24 19:09:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:09:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:23 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Deleted allocations for instance 0a26aa8a-384a-4bb2-9952-61724355bee8
Nov 24 19:09:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-17cada39-26d3-4067-950c-6ba3d80d22e3 tempest-TestStampPattern-1820980037 tempest-TestStampPattern-1820980037-project-member] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] Acquiring lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] Lock "0a26aa8a-384a-4bb2-9952-61724355bee8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] No waiting events found dispatching network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:24 user nova-compute[75051]: WARNING nova.compute.manager [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received unexpected event network-vif-plugged-db6ce854-31dd-4987-b595-1a5d9cbfdd1d for instance with vm_state deleted and task_state None.
Nov 24 19:09:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-e8740604-1832-46a9-9e24-2e574f973b27 req-8b0ce04f-c75d-408a-90c8-c264dcbddef5 service nova] [instance: 0a26aa8a-384a-4bb2-9952-61724355bee8] Received event network-vif-deleted-db6ce854-31dd-4987-b595-1a5d9cbfdd1d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [{"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-253d389a-0014-4ae6-a631-e401cf63a697" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:09:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:09:43 user nova-compute[75051]: INFO nova.compute.claims [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Claim successful on node user
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:09:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.policy [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7cd8f02d33451dab0dd657dae58e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd3c174a2f54797b24dba9c5eab26fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:09:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Creating image(s)
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Successfully created port: edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.virt.images [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] 764ddaee-2c61-4346-ac4a-d58246fabd96 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.part /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.part /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.converted" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.982s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Successfully updated port: edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing instance network info cache due to event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd,backing_fmt=raw /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd,backing_fmt=raw /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk 1073741824" returned: 0 in 0.046s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "9629ebfc2076cb7b871dc9a453cbe85a80419fcd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance network_info: |[{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Cannot resize image /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Ensure instance console log exists: /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start _get_guest_xml network_info=[{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T19:09:41Z,direct_url=<?>,disk_format='qcow2',id=764ddaee-2c61-4346-ac4a-d58246fabd96,min_disk=0,min_ram=0,name='tempest-scenario-img--13249678',owner='3dd3c174a2f54797b24dba9c5eab26fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T19:09:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '764ddaee-2c61-4346-ac4a-d58246fabd96'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:09:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T19:09:41Z,direct_url=<?>,disk_format='qcow2',id=764ddaee-2c61-4346-ac4a-d58246fabd96,min_disk=0,min_ram=0,name='tempest-scenario-img--13249678',owner='3dd3c174a2f54797b24dba9c5eab26fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T19:09:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:09:44Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:09:46 user nova-compute[75051]:   <uuid>3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</uuid>
Nov 24 19:09:46 user nova-compute[75051]:   <name>instance-00000021</name>
Nov 24 19:09:46 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:09:46 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:09:46 user nova-compute[75051]:   <metadata>
Nov 24 19:09:46 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:09:46 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:name>tempest-TestMinimumBasicScenario-server-698835302</nova:name>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:09:46</nova:creationTime>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:09:46 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:09:46 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:owner>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:user uuid="4e7cd8f02d33451dab0dd657dae58e5e">tempest-TestMinimumBasicScenario-351181186-project-member</nova:user>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:project uuid="3dd3c174a2f54797b24dba9c5eab26fa">tempest-TestMinimumBasicScenario-351181186</nova:project>
Nov 24 19:09:46 user nova-compute[75051]:       </nova:owner>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:root type="image" uuid="764ddaee-2c61-4346-ac4a-d58246fabd96"/>
Nov 24 19:09:46 user nova-compute[75051]:       <nova:ports>
Nov 24 19:09:46 user nova-compute[75051]:         <nova:port uuid="edacc8ca-5696-459f-8b16-c0f112cfe689">
Nov 24 19:09:46 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:09:46 user nova-compute[75051]:         </nova:port>
Nov 24 19:09:46 user nova-compute[75051]:       </nova:ports>
Nov 24 19:09:46 user nova-compute[75051]:     </nova:instance>
Nov 24 19:09:46 user nova-compute[75051]:   </metadata>
Nov 24 19:09:46 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:09:46 user nova-compute[75051]:     <system>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="serial">3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</entry>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="uuid">3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</entry>
Nov 24 19:09:46 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:09:46 user nova-compute[75051]:     </system>
Nov 24 19:09:46 user nova-compute[75051]:   </sysinfo>
Nov 24 19:09:46 user nova-compute[75051]:   <os>
Nov 24 19:09:46 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:09:46 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:09:46 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:09:46 user nova-compute[75051]:   </os>
Nov 24 19:09:46 user nova-compute[75051]:   <features>
Nov 24 19:09:46 user nova-compute[75051]:     <acpi/>
Nov 24 19:09:46 user nova-compute[75051]:     <apic/>
Nov 24 19:09:46 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:09:46 user nova-compute[75051]:   </features>
Nov 24 19:09:46 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:09:46 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:09:46 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:09:46 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:09:46 user nova-compute[75051]:   </clock>
Nov 24 19:09:46 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:09:46 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:09:46 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:09:46 user nova-compute[75051]:   </cpu>
Nov 24 19:09:46 user nova-compute[75051]:   <devices>
Nov 24 19:09:46 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:09:46 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:09:46 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk"/>
Nov 24 19:09:46 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:09:46 user nova-compute[75051]:     </disk>
Nov 24 19:09:46 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:09:46 user nova-compute[75051]:       <mac address="fa:16:3e:f1:8b:32"/>
Nov 24 19:09:46 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:09:46 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:09:46 user nova-compute[75051]:       <target dev="tapedacc8ca-56"/>
Nov 24 19:09:46 user nova-compute[75051]:     </interface>
Nov 24 19:09:46 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:09:46 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/console.log" append="off"/>
Nov 24 19:09:46 user nova-compute[75051]:     </serial>
Nov 24 19:09:46 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:09:46 user nova-compute[75051]:     <video>
Nov 24 19:09:46 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:09:46 user nova-compute[75051]:     </video>
Nov 24 19:09:46 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:09:46 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:09:46 user nova-compute[75051]:     </rng>
Nov 24 19:09:46 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:09:46 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:09:46 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:09:46 user nova-compute[75051]:     </memballoon>
Nov 24 19:09:46 user nova-compute[75051]:   </devices>
Nov 24 19:09:46 user nova-compute[75051]: </domain>
Nov 24 19:09:46 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:09:44Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG os_vif [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24676a9a-a060-524a-9b70-eb7d562a7bcc', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedacc8ca-56, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedacc8ca-56, col_values=(('qos', UUID('794024cf-afef-40ca-a35c-c4ce05ac9f7b')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedacc8ca-56, col_values=(('external_ids', {'iface-id': 'edacc8ca-5696-459f-8b16-c0f112cfe689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:8b:32', 'vm-uuid': '3d3f52c0-dfa7-496c-9c7a-bc56e76794c8'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:46 user nova-compute[75051]: INFO os_vif [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56')
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No VIF found with MAC fa:16:3e:f1:8b:32, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updated VIF entry in instance network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG nova.network.neutron [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:09:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5ce4c8cf-e85a-46c4-8f7f-0f93fbda1ea9 req-ab7ca8d1-1577-44fb-8be6-c55772a5068d service nova] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:47 user nova-compute[75051]: WARNING nova.compute.manager [req-12173a5a-d4ad-490e-8923-ac05249a5e92 req-bd962443-b98e-475e-a93a-f5fa90e91987 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state building and task_state spawning.
Nov 24 19:09:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:09:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance spawned successfully.
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:09:50 user nova-compute[75051]: INFO nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 24 19:09:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:09:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:09:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:09:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:09:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:09:50 user nova-compute[75051]: WARNING nova.compute.manager [req-04cd22ea-9c21-408e-b24f-e58676c50314 req-ea67a88e-ef6b-434c-b04d-b267940cf294 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state building and task_state spawning.
Nov 24 19:09:50 user nova-compute[75051]: INFO nova.compute.manager [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Took 6.29 seconds to build instance.
Nov 24 19:09:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-588fea35-5237-477e-83cd-dff3008d8614 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.382s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:09:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:09:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:10 user nova-compute[75051]: DEBUG nova.compute.manager [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:10 user nova-compute[75051]: DEBUG nova.compute.manager [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing instance network info cache due to event network-changed-f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:10:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:10 user nova-compute[75051]: DEBUG nova.network.neutron [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Refreshing network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:10:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated VIF entry in instance network info cache for port f1eb287e-95db-4df1-87fe-cf8738161dd5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:10:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e9ca2a06-5bd1-4dd4-a9df-7b9248b025a9 req-f7e446da-47a7-4abb-ad3d-cdb181d631de service nova] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Stashing vm_state: active {{(pid=75051) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:10:12 user nova-compute[75051]: INFO nova.compute.claims [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Claim successful on node user
Nov 24 19:10:12 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating resource usage from migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.478s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:12 user nova-compute[75051]: INFO nova.compute.manager [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Migrating
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-changed-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Refreshing instance network info cache due to event network-changed-64c1e144-62f9-4d97-96fb-1ab66a6016e5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Refreshing network info cache for port 64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:10:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updated VIF entry in instance network info cache for port 64c1e144-62f9-4d97-96fb-1ab66a6016e5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1794d9b-343d-4cb5-98f6-fc1bd658ffd8 req-6783da93-667d-47d3-a49e-a2bc4f3d31a8 service nova] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Starting migrate_disk_and_power_off {{(pid=75051) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:14 user nova-compute[75051]: WARNING nova.compute.manager [req-3db8f24f-21c9-49ef-a8ab-564433831566 req-bc8acb6d-33e7-48c1-84ae-21e1610dc38e service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state active and task_state resize_migrating.
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:14 user nova-compute[75051]: INFO nova.compute.manager [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Terminating instance
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance destroyed successfully.
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG os_vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c1e144-62, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f30be09-6173-4d41-9caa-c6b3d3178ab2) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: INFO os_vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62')
Nov 24 19:10:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:14 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:14 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b459bb1-d8c1-4994-a5f0-aca229368ed7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]: iSNS:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]: STATIC:
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: FIRMWARE:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:10:15 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:10:15 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da032f89-04e2-4d9f-91de-7cb560673628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c822c-6baf-4e9a-9575-64765e25deb9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a049b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4fecbc-f1d9-4094-bada-e13c4a564868]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f618ef0-c93d-4244-94b1-7f2ff90473c8]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe733ef-10c7-460d-9d0f-195a426361b7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4d9f8-a43e-426f-9771-95d9faac7e1d]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3436fec7-c39bfa71cd17d1a4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3436fec7', '/dev/disk/by-id/scsi-26333396266613731') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e0ca1-695f-47b9-a8a6-4e90c0a3a053]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e56d42-fcc6-4db7-b073-1085d2973d83]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Instance destroyed successfully.
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid 253d389a-0014-4ae6-a631-e401cf63a697 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-405124060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-405124060',id=27,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-b9vto5l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:08:28Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=253d389a-0014-4ae6-a631-e401cf63a697,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "address": "fa:16:3e:07:92:99", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ad7e0da-34", "ovs_interfaceid": "6ad7e0da-34a4-4320-aa92-08c512ee482d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_vif [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0828d47c-1e57-4dae-b5c6-12fa186e1424]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]
Nov 24 19:10:15 user nova-compute[75051]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ad7e0da-34, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=925d2117-e5d0-44e8-a5e1-ea72a56429e8) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb34ed1-8700-4dfa-a169-de302dd17c88]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== disconnect_volume: return (422ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:10:15 user nova-compute[75051]: INFO os_vif [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:92:99,bridge_name='br-int',has_traffic_filtering=True,id=6ad7e0da-34a4-4320-aa92-08c512ee482d,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ad7e0da-34')
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJAkDPSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb76b60-d7d2-47fe-a23d-6684c5a25a79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]: iSNS:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]: STATIC:
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:10:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:15 user nova-compute[75051]: FIRMWARE:
Nov 24 19:10:15 user nova-compute[75051]: No targets found.
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:10:15 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:10:15 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f25a9a-c189-48d1-9b8a-9746823e835d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aed86e-49e4-43d4-a516-1b04678ef5ec]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:15 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a049a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7f1e7-eafb-49c9-80c9-903731a3fb16]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c80c0e-8c07-473d-a1ee-53d7bcc12d13]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[34564fa1-6e72-4447-8174-56c5e878feea]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff5a1b0-3d54-4d2b-b4d5-67df6876a092]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c52efce', '/dev/disk/by-id/scsi-1SCST_BIO2c52efce-bc20d694d05ee150', '/dev/disk/by-id/scsi-26263323064363934') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae046611-d406-4a5d-8d82-08b535a9b404]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4e64de-17f8-4376-bb51-cf337bbb0b49]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2ae0c1-1abe-4ed5-be56-079964f41ecd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260]
Nov 24 19:10:15 user nova-compute[75051]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0bdb232-84c0-4a6c-9340-1c9662232235 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbfc0c2-58c3-48e4-be96-c6941aca5583]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== disconnect_volume: return (348ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:10:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Deleting instance files /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697_del
Nov 24 19:10:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Deletion of /opt/stack/data/nova/instances/253d389a-0014-4ae6-a631-e401cf63a697_del complete
Nov 24 19:10:15 user nova-compute[75051]: INFO nova.compute.manager [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 24 19:10:15 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:10:15 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:16 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Took 0.46 seconds to deallocate network for instance.
Nov 24 19:10:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Port 64c1e144-62f9-4d97-96fb-1ab66a6016e5 binding to destination host user is already ACTIVE {{(pid=75051) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:16 user nova-compute[75051]: WARNING nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state active and task_state resize_migrating.
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-unplugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Acquiring lock "253d389a-0014-4ae6-a631-e401cf63a697-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] Lock "253d389a-0014-4ae6-a631-e401cf63a697-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] No waiting events found dispatching network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:16 user nova-compute[75051]: WARNING nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received unexpected event network-vif-plugged-6ad7e0da-34a4-4320-aa92-08c512ee482d for instance with vm_state active and task_state deleting.
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-cdef7f3c-fe51-4ff4-82ac-114cca42c20d req-c18d298b-6d37-4440-bf4a-e4be90d02fc9 service nova] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Received event network-vif-deleted-6ad7e0da-34a4-4320-aa92-08c512ee482d {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:10:17 user nova-compute[75051]: INFO nova.compute.manager [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 253d389a-0014-4ae6-a631-e401cf63a697] Took 0.83 seconds to detach 1 volumes for instance.
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:17 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Deleted allocations for instance 253d389a-0014-4ae6-a631-e401cf63a697
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.utils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e618a5-467b-4c4f-9ada-3af8ec654867]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[852474d2-398c-4bd0-b5e3-61fa51ecb004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1ec614-87e0-4b09-b72d-ac9b0580f986]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52ae74-1681-485f-b11a-c78d8ecafc73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-474c72a9-6e1e-422f-95a1-1c43ccbd8b40 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "253d389a-0014-4ae6-a631-e401cf63a697" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:10:17 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5512eba2-6c4c-4172-adb9-bb4e5e4fe2dc]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG os_brick.utils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:20 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8211MB free_disk=25.09062957763672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Applying migration context for instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e as it has an incoming, in-progress migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817. Migration status is post-migrating {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 19:10:20 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating resource usage from migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 956f4b65-634b-4b22-b72c-d6df5ffff225 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:10:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Starting finish_migration {{(pid=75051) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 19:10:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Creating image(s)
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Ensure instance console log exists: /opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start _get_guest_xml network_info=[{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6a9e43fd-eda8-4d2c-aa58-555dafb1a58e', 'attached_at': '2023-11-24T19:10:24.000000', 'detached_at': '', 'volume_id': '685790db-ad8b-4088-9115-3e0e64273dff', 'serial': '685790db-ad8b-4088-9115-3e0e64273dff'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e434c849-7016-4cd9-9d0d-6c8e929bc37a', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:10:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:24 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:24 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:24 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83be3e0-fa1e-4c68-a5d7-86cfedd6062a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:10:24 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[69861b8b-214e-4c51-b23d-078584f0d4b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff] added
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f96e50b-0893-45ca-8be0-9b0450732b17]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73333f91-215f-4819-9f42-93e0d7b3c8b8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGoPvXQC {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eGoPvXQC" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43a658-a05d-4578-984b-af1ce4de946a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eGoPvXQC'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf403855-c72a-45fb-8732-7806fa640ebf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2383d-0189-4dee-9b37-300e7776e377]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d197b-7594-4359-b187-e4d5acd50af9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]
Nov 24 19:10:24 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[328760a9-4be1-42b3-b183-ce68ed5c4215]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[734aa9ca-dd93-42b8-a176-20d611f61d80]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:24 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55d436-4ae7-4afe-8c8a-5bb03fd21646]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26333396266613731', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333396266613731', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:10:25 user nova-compute[75051]:   <uuid>6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</uuid>
Nov 24 19:10:25 user nova-compute[75051]:   <name>instance-00000020</name>
Nov 24 19:10:25 user nova-compute[75051]:   <memory>2097152</memory>
Nov 24 19:10:25 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:10:25 user nova-compute[75051]:   <metadata>
Nov 24 19:10:25 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:10:25 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:10:25 user nova-compute[75051]:       <nova:name>tempest-ServerActionsTestOtherA-server-271988235</nova:name>
Nov 24 19:10:25 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:10:24</nova:creationTime>
Nov 24 19:10:25 user nova-compute[75051]:       <nova:flavor name="m1.small">
Nov 24 19:10:25 user nova-compute[75051]:         <nova:memory>2048</nova:memory>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:disk>20</nova:disk>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:10:25 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:10:25 user nova-compute[75051]:       <nova:owner>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:user uuid="1542a899903c40dfba0d4b274b547b73">tempest-ServerActionsTestOtherA-214702841-project-member</nova:user>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:project uuid="9ae5e7665a994fe29c206c1b53c5359f">tempest-ServerActionsTestOtherA-214702841</nova:project>
Nov 24 19:10:25 user nova-compute[75051]:       </nova:owner>
Nov 24 19:10:25 user nova-compute[75051]:       <nova:ports>
Nov 24 19:10:25 user nova-compute[75051]:         <nova:port uuid="64c1e144-62f9-4d97-96fb-1ab66a6016e5">
Nov 24 19:10:25 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:10:25 user nova-compute[75051]:         </nova:port>
Nov 24 19:10:25 user nova-compute[75051]:       </nova:ports>
Nov 24 19:10:25 user nova-compute[75051]:     </nova:instance>
Nov 24 19:10:25 user nova-compute[75051]:   </metadata>
Nov 24 19:10:25 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:10:25 user nova-compute[75051]:     <system>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="serial">6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</entry>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="uuid">6a9e43fd-eda8-4d2c-aa58-555dafb1a58e</entry>
Nov 24 19:10:25 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:10:25 user nova-compute[75051]:     </system>
Nov 24 19:10:25 user nova-compute[75051]:   </sysinfo>
Nov 24 19:10:25 user nova-compute[75051]:   <os>
Nov 24 19:10:25 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:10:25 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:10:25 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:10:25 user nova-compute[75051]:   </os>
Nov 24 19:10:25 user nova-compute[75051]:   <features>
Nov 24 19:10:25 user nova-compute[75051]:     <acpi/>
Nov 24 19:10:25 user nova-compute[75051]:     <apic/>
Nov 24 19:10:25 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:10:25 user nova-compute[75051]:   </features>
Nov 24 19:10:25 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:10:25 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:10:25 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:10:25 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:10:25 user nova-compute[75051]:   </clock>
Nov 24 19:10:25 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:10:25 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:10:25 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:10:25 user nova-compute[75051]:   </cpu>
Nov 24 19:10:25 user nova-compute[75051]:   <devices>
Nov 24 19:10:25 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:10:25 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:10:25 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:10:25 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:10:25 user nova-compute[75051]:       <serial>685790db-ad8b-4088-9115-3e0e64273dff</serial>
Nov 24 19:10:25 user nova-compute[75051]:     </disk>
Nov 24 19:10:25 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:10:25 user nova-compute[75051]:       <mac address="fa:16:3e:9b:6e:8a"/>
Nov 24 19:10:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:10:25 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:10:25 user nova-compute[75051]:       <target dev="tap64c1e144-62"/>
Nov 24 19:10:25 user nova-compute[75051]:     </interface>
Nov 24 19:10:25 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:10:25 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e/console.log" append="off"/>
Nov 24 19:10:25 user nova-compute[75051]:     </serial>
Nov 24 19:10:25 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:10:25 user nova-compute[75051]:     <video>
Nov 24 19:10:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:10:25 user nova-compute[75051]:     </video>
Nov 24 19:10:25 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:10:25 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:10:25 user nova-compute[75051]:     </rng>
Nov 24 19:10:25 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:10:25 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:10:25 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:10:25 user nova-compute[75051]:     </memballoon>
Nov 24 19:10:25 user nova-compute[75051]:   </devices>
Nov 24 19:10:25 user nova-compute[75051]: </domain>
Nov 24 19:10:25 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:08:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1104042268-network", "vif_mac": "fa:16:3e:9b:6e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG os_vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1a9a428-976b-5458-85b4-deffaa0f7151', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c1e144-62, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c1e144-62, col_values=(('qos', UUID('0e1d5b46-155e-4a89-a750-a7154f6e8f2d')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c1e144-62, col_values=(('external_ids', {'iface-id': '64c1e144-62f9-4d97-96fb-1ab66a6016e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:6e:8a', 'vm-uuid': '6a9e43fd-eda8-4d2c-aa58-555dafb1a58e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:25 user nova-compute[75051]: INFO os_vif [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62')
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] No VIF found with MAC fa:16:3e:9b:6e:8a, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:10:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:27 user nova-compute[75051]: WARNING nova.compute.manager [req-0a11d783-7370-4f9f-b2e9-9a44ccea18f8 req-6ac923ec-f2ba-4f24-8d28-6d72010b2e36 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state active and task_state resize_finish.
Nov 24 19:10:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:10:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance running successfully.
Nov 24 19:10:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Failed to set time: agent not configured {{(pid=75051) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 24 19:10:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85288984-e57c-430b-96bd-b07fbea4f76f tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] finish_migration finished successfully. {{(pid=75051) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 24 19:10:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:29 user nova-compute[75051]: WARNING nova.compute.manager [req-78a76a66-4364-46c3-82e0-b1376966be44 req-4fb21bb9-2e3d-44e1-ab28-321cdc5ed041 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state resized and task_state None.
Nov 24 19:10:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'info_cache' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:43 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance destroyed successfully.
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'resources' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0930de9a-90, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ace92af-8ca8-483e-9c1b-85c5cb92099e) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:44 user nova-compute[75051]: INFO os_vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66e904-f4b8-4338-b45f-1cdfe603b8c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:10:44 user nova-compute[75051]: No targets found.
Nov 24 19:10:44 user nova-compute[75051]: iSNS:
Nov 24 19:10:44 user nova-compute[75051]: No targets found.
Nov 24 19:10:44 user nova-compute[75051]: STATIC:
Nov 24 19:10:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:10:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:10:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:10:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:10:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:44 user nova-compute[75051]: FIRMWARE:
Nov 24 19:10:44 user nova-compute[75051]: No targets found.
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:10:44 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:10:44 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b58c21-1ce8-4b84-89fc-cfda4654918d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[091ecc62-959f-4474-b09a-736a495254fc]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b83524d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7a24b4-9303-43d6-ba5b-4d79b73fbf2c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a89567-e086-4d52-96fd-2690bac823a9]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cc1279-44bc-4b2d-82c7-eac5671695b5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb38b4-4eab-4529-88de-8957e15539d3]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320a72a-0ae7-4f26-bf24-b32fe5788d25]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e92e58-a329-4fa7-91ab-40539caffb86]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]
Nov 24 19:10:44 user nova-compute[75051]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b3921c-e80f-4c59-9010-6cfaac98b9c2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== disconnect_volume: return (308ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start _get_guest_xml network_info=[{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0a4bd91d-ace4-41e5-a9e6-0dd291622b45', 'attached_at': '', 'detached_at': '', 'volume_id': 'e909bbea-d5af-4339-b21b-5893d064f615', 'serial': 'e909bbea-d5af-4339-b21b-5893d064f615'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '0678e724-0c5f-4a45-99fd-9e32bd71657a', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:44 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359b88d-30e4-47ae-ba36-23160a68c132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:10:44 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f1805-c846-45e1-85aa-5489b09a499f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615] added
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff0499-59cd-43d4-a75b-e72056e5c8a4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[430293ed-ae7e-4714-956b-7b928693987b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqVXkFlZ {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqVXkFlZ" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[590c5cf6-fb11-45e2-9db3-1bf9f7b46919]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqVXkFlZ'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f621d9b-ee36-48c9-8f24-822872e535d2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb098008-0f21-488e-887c-9d50d06c2fe8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ddf81d-4c63-4a1b-bb37-f900979ee3ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]
Nov 24 19:10:44 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb751e5-3155-42a1-a580-97907765537f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4095723b-7244-40f6-9ad6-17abe5d85989]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe2110a-c748-4f0b-9c7a-90db0ed3c56b]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing instance network info cache due to event network-changed-f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] Acquiring lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] Acquired lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Refreshing network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:45 user nova-compute[75051]: INFO nova.compute.manager [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Terminating instance
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-f30523ec-a0be-4fc4-b2b4-7ebfcad394e3 req-f954b12e-78d1-4fd5-a266-76c7f24cbc34 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-unplugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23734383430643938', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383430643938', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:10:45 user nova-compute[75051]:   <uuid>0a4bd91d-ace4-41e5-a9e6-0dd291622b45</uuid>
Nov 24 19:10:45 user nova-compute[75051]:   <name>instance-0000001f</name>
Nov 24 19:10:45 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:10:45 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:10:45 user nova-compute[75051]:   <metadata>
Nov 24 19:10:45 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:10:45 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeTestJSON-server-1975778758</nova:name>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:10:44</nova:creationTime>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:10:45 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:10:45 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:owner>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:user uuid="623c9f272b0e44f1a14364d1f90fc762">tempest-AttachVolumeTestJSON-866610194-project-member</nova:user>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:project uuid="2c07aa581fa647a39092777af5ee366d">tempest-AttachVolumeTestJSON-866610194</nova:project>
Nov 24 19:10:45 user nova-compute[75051]:       </nova:owner>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:10:45 user nova-compute[75051]:       <nova:ports>
Nov 24 19:10:45 user nova-compute[75051]:         <nova:port uuid="0930de9a-909c-4368-8b12-b7d3c8ee618f">
Nov 24 19:10:45 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:10:45 user nova-compute[75051]:         </nova:port>
Nov 24 19:10:45 user nova-compute[75051]:       </nova:ports>
Nov 24 19:10:45 user nova-compute[75051]:     </nova:instance>
Nov 24 19:10:45 user nova-compute[75051]:   </metadata>
Nov 24 19:10:45 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:10:45 user nova-compute[75051]:     <system>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="serial">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="uuid">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:10:45 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:10:45 user nova-compute[75051]:     </system>
Nov 24 19:10:45 user nova-compute[75051]:   </sysinfo>
Nov 24 19:10:45 user nova-compute[75051]:   <os>
Nov 24 19:10:45 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:10:45 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:10:45 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:10:45 user nova-compute[75051]:   </os>
Nov 24 19:10:45 user nova-compute[75051]:   <features>
Nov 24 19:10:45 user nova-compute[75051]:     <acpi/>
Nov 24 19:10:45 user nova-compute[75051]:     <apic/>
Nov 24 19:10:45 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:10:45 user nova-compute[75051]:   </features>
Nov 24 19:10:45 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:10:45 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:10:45 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:10:45 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:10:45 user nova-compute[75051]:   </clock>
Nov 24 19:10:45 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:10:45 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:10:45 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:10:45 user nova-compute[75051]:   </cpu>
Nov 24 19:10:45 user nova-compute[75051]:   <devices>
Nov 24 19:10:45 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:10:45 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:10:45 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk"/>
Nov 24 19:10:45 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:10:45 user nova-compute[75051]:     </disk>
Nov 24 19:10:45 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:10:45 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:10:45 user nova-compute[75051]:       <source dev="/dev/sdd"/>
Nov 24 19:10:45 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:10:45 user nova-compute[75051]:       <serial>e909bbea-d5af-4339-b21b-5893d064f615</serial>
Nov 24 19:10:45 user nova-compute[75051]:     </disk>
Nov 24 19:10:45 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:10:45 user nova-compute[75051]:       <mac address="fa:16:3e:24:4c:23"/>
Nov 24 19:10:45 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:10:45 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:10:45 user nova-compute[75051]:       <target dev="tap0930de9a-90"/>
Nov 24 19:10:45 user nova-compute[75051]:     </interface>
Nov 24 19:10:45 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:10:45 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/console.log" append="off"/>
Nov 24 19:10:45 user nova-compute[75051]:     </serial>
Nov 24 19:10:45 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:10:45 user nova-compute[75051]:     <video>
Nov 24 19:10:45 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:10:45 user nova-compute[75051]:     </video>
Nov 24 19:10:45 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:10:45 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:10:45 user nova-compute[75051]:     </rng>
Nov 24 19:10:45 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:10:45 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:10:45 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:10:45 user nova-compute[75051]:     </memballoon>
Nov 24 19:10:45 user nova-compute[75051]:   </devices>
Nov 24 19:10:45 user nova-compute[75051]: </domain>
Nov 24 19:10:45 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updated VIF entry in instance network info cache for port f63c6b52-105f-4f6a-a33e-1450d9a99d6e. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [{"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-058c9663-5b82-42b7-a58e-26ba0ba94f25 req-06fbac38-9f15-4a78-af11-2dbea61be9bd service nova] Releasing lock "refresh_cache-956f4b65-634b-4b22-b72c-d6df5ffff225" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Instance destroyed successfully.
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lazy-loading 'resources' on Instance uuid 956f4b65-634b-4b22-b72c-d6df5ffff225 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-905072644',display_name='tempest-TestShelveInstance-server-905072644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-905072644',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIipMsvh73b8rbg19gQpwcKIdPp+wX6vjE+/5Ty9em15V0xhsrgyyWosEe5+BheW5JFPEUyKwQh47zO/eSEM/CQNVCIcF1RmyGwC8E9sIlF40tbJKISmi1C3SwzsUlW+7g==',key_name='tempest-TestShelveInstance-1755056591',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:09:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b5db41f7d844d1fb6359146dc69065e',ramdisk_id='',reservation_id='r-3ockq8bz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1748776926',owner_user_name='tempest-TestShelveInstance-1748776926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:09:08Z,user_data=None,user_id='f06e00e20a4e41e4937e491f5c040ce8',uuid=956f4b65-634b-4b22-b72c-d6df5ffff225,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converting VIF {"id": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "address": "fa:16:3e:35:bf:dd", "network": {"id": "213eb252-8d72-4804-bfec-131a7d3c8239", "bridge": "br-int", "label": "tempest-TestShelveInstance-1581913748-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b5db41f7d844d1fb6359146dc69065e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63c6b52-10", "ovs_interfaceid": "f63c6b52-105f-4f6a-a33e-1450d9a99d6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_vif [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf63c6b52-10, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2efd073e-3111-4a26-bfe6-c3b3d298b4b2) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: INFO os_vif [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:bf:dd,bridge_name='br-int',has_traffic_filtering=True,id=f63c6b52-105f-4f6a-a33e-1450d9a99d6e,network=Network(213eb252-8d72-4804-bfec-131a7d3c8239),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63c6b52-10')
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqfnUrMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:10:46 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba9a91-a2f4-4f9c-a572-95b2d1ffd059]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:10:46 user nova-compute[75051]: No targets found.
Nov 24 19:10:46 user nova-compute[75051]: iSNS:
Nov 24 19:10:46 user nova-compute[75051]: No targets found.
Nov 24 19:10:46 user nova-compute[75051]: STATIC:
Nov 24 19:10:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:10:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:10:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d
Nov 24 19:10:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:10:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:10:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:10:46 user nova-compute[75051]: FIRMWARE:
Nov 24 19:10:46 user nova-compute[75051]: No targets found.
Nov 24 19:10:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:10:46 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:10:46 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ea407-1616-4be0-9466-07ac668ffe9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f15efc6-19e3-444f-9e78-99318b8eb131]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:10:46 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:10:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c04ec9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d'): ({'sdg'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Removing single pathed devices sdg {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf29dd-8808-4c2a-aea3-5bec26ea23a1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abcde22-1a13-4680-bc03-f8d284825987]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Flushing IO for device /dev/sdg {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39fa8e4-b5ce-43df-b652-fde35caa936e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d384106b-6113-4f29-bad7-59e80f05ddab]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] SCSI volumes sdg have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf9247e-6d3e-49b4-b73a-ae7f8e8f646f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1cd8b6-2036-4655-8d17-a008a505966b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260]
Nov 24 19:10:46 user nova-compute[75051]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d, portal: 172.16.0.220,3260] successful.
Nov 24 19:10:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9097e29f-8904-4b62-ba38-57b50ee5ea9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe70a574-5623-4968-b292-49424a98028e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] <== disconnect_volume: return (358ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:10:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deleting instance files /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225_del
Nov 24 19:10:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deletion of /opt/stack/data/nova/instances/956f4b65-634b-4b22-b72c-d6df5ffff225_del complete
Nov 24 19:10:46 user nova-compute[75051]: INFO nova.compute.manager [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Cannot resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'migration_context' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.objects.base [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:08:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG os_vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ad121a9-3af1-50d2-bcb4-be901984de95', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0930de9a-90, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0930de9a-90, col_values=(('qos', UUID('d344429d-4e2d-4125-871e-260d0d00dc86')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0930de9a-90, col_values=(('external_ids', {'iface-id': '0930de9a-909c-4368-8b12-b7d3c8ee618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:4c:23', 'vm-uuid': '0a4bd91d-ace4-41e5-a9e6-0dd291622b45'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:10:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:46 user nova-compute[75051]: INFO os_vif [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:10:47 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:10:47 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Took 0.58 seconds to deallocate network for instance.
Nov 24 19:10:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] Acquiring lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] No waiting events found dispatching network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:47 user nova-compute[75051]: WARNING nova.compute.manager [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received unexpected event network-vif-plugged-f63c6b52-105f-4f6a-a33e-1450d9a99d6e for instance with vm_state active and task_state deleting.
Nov 24 19:10:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-4d6f937d-65c8-48be-8a44-31899e457672 req-0fdf2a48-656f-4175-9b95-cfdc39871276 service nova] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Received event network-vif-deleted-f63c6b52-105f-4f6a-a33e-1450d9a99d6e {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:47 user nova-compute[75051]: INFO nova.compute.manager [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Took 0.79 seconds to detach 1 volumes for instance.
Nov 24 19:10:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] [instance: 956f4b65-634b-4b22-b72c-d6df5ffff225] Deleting volume: 9097e29f-8904-4b62-ba38-57b50ee5ea9d {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:48 user nova-compute[75051]: WARNING nova.compute.manager [req-575fec53-3768-498f-bd28-c154dddf4814 req-92231809-b4a5-49c5-ab4b-6aeffb16736e service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state stopped and task_state powering-on.
Nov 24 19:10:48 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Deleted allocations for instance 956f4b65-634b-4b22-b72c-d6df5ffff225
Nov 24 19:10:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9430f35c-8744-4e49-befe-debcda6c6e1d tempest-TestShelveInstance-1748776926 tempest-TestShelveInstance-1748776926-project-member] Lock "956f4b65-634b-4b22-b72c-d6df5ffff225" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.413s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:10:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance rebooted successfully.
Nov 24 19:10:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-a26f4f78-fc1b-4d62-98af-d3c2db9fc264 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:10:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:10:50 user nova-compute[75051]: WARNING nova.compute.manager [req-a615adce-2f11-4cf2-84c4-cc8934ca4c01 req-6e26c653-e8b9-4f43-a4bb-8a2cb69d3902 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state active and task_state None.
Nov 24 19:10:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:10:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:05 user nova-compute[75051]: INFO nova.compute.manager [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Terminating instance
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-unplugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] No waiting events found dispatching network-vif-unplugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-cc0e90de-18fe-479c-90fc-a50ddf23d1e7 req-7bc67384-8f61-4133-aa6e-09893e540dc6 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-unplugged-29e89e8a-255b-417f-8481-dccc7495cf06 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Instance destroyed successfully.
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-113712468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-113712468',id=24,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:01:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-kqndix34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:03:40Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "29e89e8a-255b-417f-8481-dccc7495cf06", "address": "fa:16:3e:02:86:58", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29e89e8a-25", "ovs_interfaceid": "29e89e8a-255b-417f-8481-dccc7495cf06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG os_vif [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29e89e8a-25, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=709aafbb-7c3f-49d0-a580-6c344145e3c1) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:05 user nova-compute[75051]: INFO os_vif [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:86:58,bridge_name='br-int',has_traffic_filtering=True,id=29e89e8a-255b-417f-8481-dccc7495cf06,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29e89e8a-25')
Nov 24 19:11:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Deleting instance files /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353_del
Nov 24 19:11:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Deletion of /opt/stack/data/nova/instances/e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353_del complete
Nov 24 19:11:05 user nova-compute[75051]: INFO nova.compute.manager [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 24 19:11:05 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:11:05 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:11:06 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:06 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Took 0.50 seconds to deallocate network for instance.
Nov 24 19:11:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:11:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:11:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:06 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Deleted allocations for instance e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353
Nov 24 19:11:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6393e83b-addb-4928-8f27-77b1ed7f1f69 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.589s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] Acquiring lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] Lock "e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] No waiting events found dispatching network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:11:07 user nova-compute[75051]: WARNING nova.compute.manager [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received unexpected event network-vif-plugged-29e89e8a-255b-417f-8481-dccc7495cf06 for instance with vm_state deleted and task_state None.
Nov 24 19:11:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-0c73244b-b87d-4a2d-91d7-f465ea5698a4 req-8fd86cfa-fcae-4a3d-b215-f78abdac55a0 service nova] [instance: e588b06c-eb7a-4b7f-be3a-fe5cc1bc8353] Received event network-vif-deleted-29e89e8a-255b-417f-8481-dccc7495cf06 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:11:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:11:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:11:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:11:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=25.197254180908203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Applying migration context for instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e as it has an incoming, in-progress migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817. Migration status is finished {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 24 19:11:20 user nova-compute[75051]: INFO nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating resource usage from migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:11:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [{"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f059e874-6d1f-436c-a798-94426b9d6490" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:11:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:11:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:11:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:37 user nova-compute[75051]: INFO nova.compute.manager [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Attaching volume 19dbcaf4-bd84-41f1-8364-0ff673b1074d to /dev/vdb
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.utils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5c987-2824-40f5-8211-22324e0a4930]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[daec2630-f2b6-4856-8d0e-d4886100124f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b2c79e-9169-4670-8262-368a7b2c478f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3c40d-b611-4999-9fbd-9c3c7cf45a51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:11:37 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:11:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacbd27e-af2a-42d9-9c63-72d60e3c7e91]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG os_brick.utils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:11:37 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating existing volume attachment record: 21f9eb2e-e2d6-40ad-8155-d201c7e727a3 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:11:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:11:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:43 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f06056-01b3-456f-9c80-158471383dfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:11:43 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[157fcf12-90eb-41c4-961f-fcf916e767a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d] added
Nov 24 19:11:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[80675cad-1a28-4824-adf2-a4ca5b3b00de]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d637cd7-2205-4c12-97af-ab63265a8f03]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTsuEiOe {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTsuEiOe" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd033eee-93e5-4cac-8ce2-a6924491a20b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTsuEiOe'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b9c66f-babd-4e7e-a151-34a0dd1792ac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ebaf6-fe72-4fb4-9cbd-a219fed66861]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c220262-d989-4517-a592-9c2e34527992]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]
Nov 24 19:11:44 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.
Nov 24 19:11:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26379b3-75f2-47bb-9574-782ecdafa82e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f329c-9258-470a-8ce3-f7c14bb36f4b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:44 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe684d2-58bd-42af-9957-83eb91b25ce1]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:11:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26366366437303730', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366366437303730', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:11:45 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:11:45 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 19:11:45 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:11:45 user nova-compute[75051]:   <serial>19dbcaf4-bd84-41f1-8364-0ff673b1074d</serial>
Nov 24 19:11:45 user nova-compute[75051]: </disk>
Nov 24 19:11:45 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No VIF found with MAC fa:16:3e:f1:8b:32, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2072ebdb-ee2f-4529-88aa-cf152304e131 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.519s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing instance network info cache due to event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updated VIF entry in instance network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3967fa89-3acc-4183-9dcd-e2d6b6e97a1e req-32f8b55f-b6b1-4920-81fd-9acec27f4a57 service nova] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:11:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing instance network info cache due to event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:11:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:11:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:11:53 user nova-compute[75051]: DEBUG nova.network.neutron [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:11:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updated VIF entry in instance network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:11:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0fefa77a-530d-424b-8341-9d221be81a9e req-21b51512-630b-4f56-9791-b84caa2b9f70 service nova] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:55 user nova-compute[75051]: INFO nova.compute.manager [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Terminating instance
Nov 24 19:11:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:11:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-44a3b610-1b95-40b6-b909-d92564e9e708 req-1e7aa0bf-d453-4a7f-93d5-499a46fdc059 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-unplugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Instance destroyed successfully.
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid 71e108a3-b5c9-4ffa-ad9c-21597ebc43df {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-928277371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-928277371',id=14,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-9s0s0dbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:59:55Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=71e108a3-b5c9-4ffa-ad9c-21597ebc43df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "b98940b3-11d3-4f74-b474-3ad878481c60", "address": "fa:16:3e:74:ea:25", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98940b3-11", "ovs_interfaceid": "b98940b3-11d3-4f74-b474-3ad878481c60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_vif [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb98940b3-11, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7be47e12-264e-4fa8-a612-e1584297305d) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:56 user nova-compute[75051]: INFO os_vif [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:ea:25,bridge_name='br-int',has_traffic_filtering=True,id=b98940b3-11d3-4f74-b474-3ad878481c60,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98940b3-11')
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MTuyGqie', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:11:56 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4105cf35-d5ef-4c89-8daf-444fdadc5375]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:11:56 user nova-compute[75051]: No targets found.
Nov 24 19:11:56 user nova-compute[75051]: iSNS:
Nov 24 19:11:56 user nova-compute[75051]: No targets found.
Nov 24 19:11:56 user nova-compute[75051]: STATIC:
Nov 24 19:11:56 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:11:56 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:56 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:56 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d
Nov 24 19:11:56 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:56 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:56 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:11:56 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:56 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:56 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4
Nov 24 19:11:56 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:56 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:56 user nova-compute[75051]: FIRMWARE:
Nov 24 19:11:56 user nova-compute[75051]: No targets found.
Nov 24 19:11:56 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:11:56 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:11:56 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af2fe5-72c0-4541-9bfc-938cb0cb2772]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34d2d4f-fa34-43c2-9286-36827b3d1bd4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:56 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:56 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:56 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05aab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[022f6938-f695-4e8e-b60f-a09b00cbf76b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[288228c1-27ad-4184-abfd-f1ac3300d54e]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[08adc7c2-820a-4403-85ff-5f74d6f01ccc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[624257be-91f7-4060-97d4-b5beb7e69218]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da2040-4759-4c6a-b23a-30563b007e45]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe5cca-be49-43b8-b5f3-367e9f347c4e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260]
Nov 24 19:11:56 user nova-compute[75051]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4, portal: 172.16.0.220,3260] successful.
Nov 24 19:11:56 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd7d010b-33c1-4a6d-86fc-7ccd5a4a75b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f672b459-30dd-4662-a7d9-51f36a6b7629]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] <== disconnect_volume: return (319ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:11:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Deleting instance files /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df_del
Nov 24 19:11:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Deletion of /opt/stack/data/nova/instances/71e108a3-b5c9-4ffa-ad9c-21597ebc43df_del complete
Nov 24 19:11:56 user nova-compute[75051]: INFO nova.compute.manager [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 24 19:11:56 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:11:56 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:57 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Took 0.47 seconds to deallocate network for instance.
Nov 24 19:11:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-c57974b4-8a04-4a28-9efa-8114b7d4aba5 req-da873a6d-9889-48a5-97cc-0ff2ff161c54 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-deleted-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:57 user nova-compute[75051]: INFO nova.compute.manager [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Rebooting instance
Nov 24 19:11:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] Acquiring lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] No waiting events found dispatching network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:11:57 user nova-compute[75051]: WARNING nova.compute.manager [req-b3941f6f-860f-4f00-9802-2e7eb30e68f1 req-e3107188-bbc3-40b3-90b1-4ccb5e0d09f0 service nova] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Received unexpected event network-vif-plugged-b98940b3-11d3-4f74-b474-3ad878481c60 for instance with vm_state active and task_state deleting.
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:11:58 user nova-compute[75051]: INFO nova.compute.manager [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: 71e108a3-b5c9-4ffa-ad9c-21597ebc43df] Took 0.75 seconds to detach 1 volumes for instance.
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:58 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Deleted allocations for instance 71e108a3-b5c9-4ffa-ad9c-21597ebc43df
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c069c410-c322-4530-93be-e2a627cd7374 tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "71e108a3-b5c9-4ffa-ad9c-21597ebc43df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.889s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:11:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:11:58 user nova-compute[75051]: WARNING nova.compute.manager [req-f776cfa1-ddbe-4174-a1d5-02d34c94ad41 req-2d1c0cbf-090c-40e5-9ea5-3ea151f32f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 19:11:59 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance destroyed successfully.
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.objects.instance [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'resources' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:09:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:11:59Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedacc8ca-56, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=794024cf-afef-40ca-a35c-c4ce05ac9f7b) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:11:59 user nova-compute[75051]: INFO os_vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56')
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:11:59 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[786de08d-3830-4161-b170-85a5fbbad551]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:11:59 user nova-compute[75051]: No targets found.
Nov 24 19:11:59 user nova-compute[75051]: iSNS:
Nov 24 19:11:59 user nova-compute[75051]: No targets found.
Nov 24 19:11:59 user nova-compute[75051]: STATIC:
Nov 24 19:11:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:11:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d
Nov 24 19:11:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:11:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:11:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:11:59 user nova-compute[75051]: FIRMWARE:
Nov 24 19:11:59 user nova-compute[75051]: No targets found.
Nov 24 19:11:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:11:59 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:11:59 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[487c4531-fa7d-42c4-896e-f528ddfe633d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b516fd2-e387-47c8-a14d-f7b2984e39ae]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:59 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:59 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:11:59 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:11:59 user nova-compute[75051]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:11:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a059a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a68eda-8c26-49b3-9384-99474ea82001]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802a523-c9f3-4cd3-8d14-90119e74fc7f]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f70e490-dac7-4075-85de-92b8fd88441a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4d5dc2-f203-4a22-8179-c8245374aa0c]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7c895-d09c-4610-b7df-1a69c6c51654]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f53aa-cbb3-4f7c-8795-8691fb42ab87]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]
Nov 24 19:11:59 user nova-compute[75051]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.
Nov 24 19:11:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[844851b3-683e-4436-8d0e-4390f363cd3c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== disconnect_volume: return (299ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start _get_guest_xml network_info=[{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=764ddaee-2c61-4346-ac4a-d58246fabd96,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '764ddaee-2c61-4346-ac4a-d58246fabd96'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '3d3f52c0-dfa7-496c-9c7a-bc56e76794c8', 'attached_at': '', 'detached_at': '', 'volume_id': '19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'serial': '19dbcaf4-bd84-41f1-8364-0ff673b1074d'}, 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '21f9eb2e-e2d6-40ad-8155-d201c7e727a3', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:11:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:11:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=764ddaee-2c61-4346-ac4a-d58246fabd96,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.objects.instance [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.objects.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Object Instance<3d3f52c0-dfa7-496c-9c7a-bc56e76794c8> lazy-loaded attributes: resources,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:11:59 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:59 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:11:59 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[27848090-636d-4004-b206-8d561a3b7010]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:11:59 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73490bb8-968e-4a7f-b428-77123e01e8ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d] added
Nov 24 19:11:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c699bc4e-cc56-461c-b1fb-87dcf14d1ce4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c53bec3-fb25-4b2f-b89b-c2551e2ae63e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:11:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTsuEiOe {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KTsuEiOe" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290e753-d950-445c-be93-ba0c536ee4c3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KTsuEiOe'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc5b9d5-ba7d-4b7b-a35a-1f49441335f0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6945df74-e191-4485-a9fb-44c201317bce]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:00 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:00 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9674ef0-12de-4eb5-bbce-625191b22213]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]
Nov 24 19:12:00 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.
Nov 24 19:12:00 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[14daf8b1-fc0d-4f1f-9854-bda8cced7c95]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc50a6-836e-457e-9ba2-ff95f0c7cf73]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:12:00 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:00 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:12:00 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[02456da3-e2e9-4b03-affa-3f1bb805e2fd]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:00 user nova-compute[75051]: WARNING nova.compute.manager [req-3bc222ec-86d9-4a0c-9899-18d3e3eea91f req-9eeff64e-ce42-4f6f-8675-a4e97c154f17 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 19:12:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26366366437303730', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366366437303730', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:09:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:11:59Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.objects.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Object Instance<3d3f52c0-dfa7-496c-9c7a-bc56e76794c8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:12:01 user nova-compute[75051]:   <uuid>3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</uuid>
Nov 24 19:12:01 user nova-compute[75051]:   <name>instance-00000021</name>
Nov 24 19:12:01 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:12:01 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:12:01 user nova-compute[75051]:   <metadata>
Nov 24 19:12:01 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:12:01 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:name>tempest-TestMinimumBasicScenario-server-698835302</nova:name>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:11:59</nova:creationTime>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:12:01 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:12:01 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:owner>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:user uuid="4e7cd8f02d33451dab0dd657dae58e5e">tempest-TestMinimumBasicScenario-351181186-project-member</nova:user>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:project uuid="3dd3c174a2f54797b24dba9c5eab26fa">tempest-TestMinimumBasicScenario-351181186</nova:project>
Nov 24 19:12:01 user nova-compute[75051]:       </nova:owner>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:root type="image" uuid="764ddaee-2c61-4346-ac4a-d58246fabd96"/>
Nov 24 19:12:01 user nova-compute[75051]:       <nova:ports>
Nov 24 19:12:01 user nova-compute[75051]:         <nova:port uuid="edacc8ca-5696-459f-8b16-c0f112cfe689">
Nov 24 19:12:01 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:12:01 user nova-compute[75051]:         </nova:port>
Nov 24 19:12:01 user nova-compute[75051]:       </nova:ports>
Nov 24 19:12:01 user nova-compute[75051]:     </nova:instance>
Nov 24 19:12:01 user nova-compute[75051]:   </metadata>
Nov 24 19:12:01 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:12:01 user nova-compute[75051]:     <system>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="serial">3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</entry>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="uuid">3d3f52c0-dfa7-496c-9c7a-bc56e76794c8</entry>
Nov 24 19:12:01 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:12:01 user nova-compute[75051]:     </system>
Nov 24 19:12:01 user nova-compute[75051]:   </sysinfo>
Nov 24 19:12:01 user nova-compute[75051]:   <os>
Nov 24 19:12:01 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:12:01 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:12:01 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:12:01 user nova-compute[75051]:   </os>
Nov 24 19:12:01 user nova-compute[75051]:   <features>
Nov 24 19:12:01 user nova-compute[75051]:     <acpi/>
Nov 24 19:12:01 user nova-compute[75051]:     <apic/>
Nov 24 19:12:01 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:12:01 user nova-compute[75051]:   </features>
Nov 24 19:12:01 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:12:01 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:12:01 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:12:01 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:12:01 user nova-compute[75051]:   </clock>
Nov 24 19:12:01 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:12:01 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:12:01 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:12:01 user nova-compute[75051]:   </cpu>
Nov 24 19:12:01 user nova-compute[75051]:   <devices>
Nov 24 19:12:01 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:12:01 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:12:01 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk"/>
Nov 24 19:12:01 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:12:01 user nova-compute[75051]:     </disk>
Nov 24 19:12:01 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:12:01 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:12:01 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 19:12:01 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:12:01 user nova-compute[75051]:       <serial>19dbcaf4-bd84-41f1-8364-0ff673b1074d</serial>
Nov 24 19:12:01 user nova-compute[75051]:     </disk>
Nov 24 19:12:01 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:12:01 user nova-compute[75051]:       <mac address="fa:16:3e:f1:8b:32"/>
Nov 24 19:12:01 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:12:01 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:12:01 user nova-compute[75051]:       <target dev="tapedacc8ca-56"/>
Nov 24 19:12:01 user nova-compute[75051]:     </interface>
Nov 24 19:12:01 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:12:01 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/console.log" append="off"/>
Nov 24 19:12:01 user nova-compute[75051]:     </serial>
Nov 24 19:12:01 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:12:01 user nova-compute[75051]:     <video>
Nov 24 19:12:01 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:12:01 user nova-compute[75051]:     </video>
Nov 24 19:12:01 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:12:01 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:12:01 user nova-compute[75051]:     </rng>
Nov 24 19:12:01 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:12:01 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:12:01 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:12:01 user nova-compute[75051]:     </memballoon>
Nov 24 19:12:01 user nova-compute[75051]:   </devices>
Nov 24 19:12:01 user nova-compute[75051]: </domain>
Nov 24 19:12:01 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.objects.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Object Instance<3d3f52c0-dfa7-496c-9c7a-bc56e76794c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:12:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Going to confirm migration 2 {{(pid=75051) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Cannot resize image /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'migration_context' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.objects.base [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Object Instance<3d3f52c0-dfa7-496c-9c7a-bc56e76794c8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:09:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:11:59Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG os_vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24676a9a-a060-524a-9b70-eb7d562a7bcc', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedacc8ca-56, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedacc8ca-56, col_values=(('qos', UUID('9c1a7ce8-31d7-4d58-b14c-cbb918d47bad')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedacc8ca-56, col_values=(('external_ids', {'iface-id': 'edacc8ca-5696-459f-8b16-c0f112cfe689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:8b:32', 'vm-uuid': '3d3f52c0-dfa7-496c-9c7a-bc56e76794c8'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: INFO os_vif [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56')
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'info_cache' on Instance uuid 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'migration_context' on Instance uuid 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG nova.objects.base [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Object Instance<6a9e43fd-eda8-4d2c-aa58-555dafb1a58e> lazy-loaded attributes: info_cache,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.316s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:03 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Deleted allocation for migration 5847e540-b77b-4d5f-b1a4-0cbeeb057817
Nov 24 19:12:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c4e2f66a-b6b4-4537-9a14-862f5888b028 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.259s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:03 user nova-compute[75051]: WARNING nova.compute.manager [req-a385b498-f4c9-456a-9f3c-33b26b7122f4 req-e4683170-9138-4d53-b012-ad908233975c service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state active and task_state reboot_started_hard.
Nov 24 19:12:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:12:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance rebooted successfully.
Nov 24 19:12:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-daa2f1ab-6488-4865-b58f-4c24977958ee tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.738s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:05 user nova-compute[75051]: WARNING nova.compute.manager [req-644f146e-f9a9-4159-8f47-24b94497bee0 req-2e42dac6-3afb-45a1-b76d-950598d4b8c4 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state active and task_state None.
Nov 24 19:12:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:12:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:12:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:12:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8266MB free_disk=25.18548583984375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f059e874-6d1f-436c-a798-94426b9d6490 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:12:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [{"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-563ea966-1ba6-4c4d-9d01-c5293e2d6d19" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:12:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:12:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:34 user nova-compute[75051]: INFO nova.compute.manager [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Detaching volume e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:12:34 user nova-compute[75051]: INFO nova.virt.block_device [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Attempting to driver detach volume e909bbea-d5af-4339-b21b-5893d064f615 from mountpoint /dev/vdb
Nov 24 19:12:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Attempting to detach device vdb from instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:12:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:12:34 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:12:34 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:12:34 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:12:34 user nova-compute[75051]:   <serial>e909bbea-d5af-4339-b21b-5893d064f615</serial>
Nov 24 19:12:34 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:12:34 user nova-compute[75051]: </disk>
Nov 24 19:12:34 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:12:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdb from instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 from the persistent domain config.
Nov 24 19:12:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:12:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:12:34 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:12:34 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:12:34 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:12:34 user nova-compute[75051]:   <serial>e909bbea-d5af-4339-b21b-5893d064f615</serial>
Nov 24 19:12:34 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:12:34 user nova-compute[75051]: </disk>
Nov 24 19:12:34 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:12:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:12:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:46 user nova-compute[75051]: INFO nova.compute.manager [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Terminating instance
Nov 24 19:12:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-156225ce-2688-47a6-87e3-d60ddc015f78 req-7577fea1-cea9-4f56-b226-6c2e95a243c7 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:12:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Instance destroyed successfully.
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.objects.instance [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lazy-loading 'resources' on Instance uuid f059e874-6d1f-436c-a798-94426b9d6490 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1274185594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1274185594',id=2,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:52:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ae7be1d57e44aae8c9b5695bba53ef3',ramdisk_id='',reservation_id='r-1dvitbca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:54:14Z,user_data=None,user_id='88113529ca6747f281d4203c9c1d845f',uuid=f059e874-6d1f-436c-a798-94426b9d6490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converting VIF {"id": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "address": "fa:16:3e:e8:a3:2a", "network": {"id": "9c37ae31-34a8-4955-a119-f63a7dcd13d2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1681782004-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ae7be1d57e44aae8c9b5695bba53ef3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d367bf6-16", "ovs_interfaceid": "0d367bf6-1610-4aa1-8a9a-6219d104d42b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG os_vif [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d367bf6-16, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06a732f2-4a88-44f2-a953-f8ae7571210b) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:47 user nova-compute[75051]: INFO os_vif [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:a3:2a,bridge_name='br-int',has_traffic_filtering=True,id=0d367bf6-1610-4aa1-8a9a-6219d104d42b,network=Network(9c37ae31-34a8-4955-a119-f63a7dcd13d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d367bf6-16')
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Deleting instance files /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490_del
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Deletion of /opt/stack/data/nova/instances/f059e874-6d1f-436c-a798-94426b9d6490_del complete
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.compute.manager [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 24 19:12:47 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-79ccb1a9-3b64-4277-9db4-05ea0752c42b req-8d4fca7c-c469-4bb5-867e-58051aa08203 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-deleted-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.compute.manager [req-79ccb1a9-3b64-4277-9db4-05ea0752c42b req-8d4fca7c-c469-4bb5-867e-58051aa08203 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Neutron deleted interface 0d367bf6-1610-4aa1-8a9a-6219d104d42b; detaching it from the instance and deleting it from the info cache
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-79ccb1a9-3b64-4277-9db4-05ea0752c42b req-8d4fca7c-c469-4bb5-867e-58051aa08203 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:12:47 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Took 0.51 seconds to deallocate network for instance.
Nov 24 19:12:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-79ccb1a9-3b64-4277-9db4-05ea0752c42b req-8d4fca7c-c469-4bb5-867e-58051aa08203 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Detach interface failed, port_id=0d367bf6-1610-4aa1-8a9a-6219d104d42b, reason: Instance f059e874-6d1f-436c-a798-94426b9d6490 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Deleted allocations for instance f059e874-6d1f-436c-a798-94426b9d6490
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-298351d2-aed0-4f87-9c73-afe06960268b tempest-ServerBootFromVolumeStableRescueTest-1279504857 tempest-ServerBootFromVolumeStableRescueTest-1279504857-project-member] Lock "f059e874-6d1f-436c-a798-94426b9d6490" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.851s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:48 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state deleted and task_state None.
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:48 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state deleted and task_state None.
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:48 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state deleted and task_state None.
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:48 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-unplugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state deleted and task_state None.
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Acquiring lock "f059e874-6d1f-436c-a798-94426b9d6490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] Lock "f059e874-6d1f-436c-a798-94426b9d6490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] No waiting events found dispatching network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:48 user nova-compute[75051]: WARNING nova.compute.manager [req-a3d465d1-685f-42ba-91f4-f4d2b18dc522 req-e006c5fc-964f-46bb-99a6-8e5ba7c01499 service nova] [instance: f059e874-6d1f-436c-a798-94426b9d6490] Received unexpected event network-vif-plugged-0d367bf6-1610-4aa1-8a9a-6219d104d42b for instance with vm_state deleted and task_state None.
Nov 24 19:12:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:55 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 is timed out.
Nov 24 19:12:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdb from instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 from the live domain config.
Nov 24 19:12:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqVXkFlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:12:55 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa246b59-cd84-4ff4-b882-e527f1398606]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:12:55 user nova-compute[75051]: No targets found.
Nov 24 19:12:55 user nova-compute[75051]: iSNS:
Nov 24 19:12:55 user nova-compute[75051]: No targets found.
Nov 24 19:12:55 user nova-compute[75051]: STATIC:
Nov 24 19:12:55 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615
Nov 24 19:12:55 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:12:55 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:12:55 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d
Nov 24 19:12:55 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:12:55 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:12:55 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:12:55 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:12:55 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:12:55 user nova-compute[75051]: FIRMWARE:
Nov 24 19:12:55 user nova-compute[75051]: No targets found.
Nov 24 19:12:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:12:55 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:12:55 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21b69b-0083-4115-b3a6-897cfbf59747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d99124-be8e-4e6c-8870-4c431249dce9]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:55 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:55 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:12:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:12:55 user nova-compute[75051]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 (non-flash)
Nov 24 19:12:55 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:12:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0354790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35e7d7-a539-4623-ad38-412349de9c13]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81539c-3291-431c-b9c6-ca09f78f178f]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a9534-e665-490a-a116-afe9c2b5fc54]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3756239e-8405-417d-8530-ecd659c0f2b8]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b7e9d-6c5b-423c-8bd7-eedae2e0e5c7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --logout" returned: 0 in 0.125s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e428f169-15c3-4a15-a307-d76f7558b932]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260]
Nov 24 19:12:55 user nova-compute[75051]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615, portal: 172.16.0.220,3260] successful.
Nov 24 19:12:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e909bbea-d5af-4339-b21b-5893d064f615 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a772d-e366-4e18-8003-8a3a32b99a46]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== disconnect_volume: return (425ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:12:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:12:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-56f642e3-14ea-41e2-9f9d-d589a23356bd tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.919s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75051) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:57 user nova-compute[75051]: WARNING nova.compute.manager [req-35e0d0ba-a7fd-46d2-8b76-3838d0fdbc6d req-22c61074-a29b-4234-ba53-23e823855b84 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state active and task_state powering-off.
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:12:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance destroyed successfully.
Nov 24 19:12:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:12:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6215560e-a98b-4314-a9d1-a1fd17b3d0e5 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.170s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:12:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:12:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:12:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:12:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:12:59 user nova-compute[75051]: WARNING nova.compute.manager [req-84b192e9-0b9b-47b7-bfa2-03b3d1410d62 req-0ba20128-59ee-45ab-9487-2e22c226b0d0 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state stopped and task_state None.
Nov 24 19:13:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:17 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:13:19 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.309585571289062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:13:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:13:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:13:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:13:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:13:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:13:48 user nova-compute[75051]: INFO nova.compute.claims [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Claim successful on node user
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:13:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.policy [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c20e8819f346e8b5c57a77becb0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3182a5d4540cfab6a2a919f79f3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:13:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Creating image(s)
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk 1073741824" returned: 0 in 0.046s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Successfully created port: 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Cannot resize image /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Ensure instance console log exists: /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing instance network info cache due to event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:13:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Successfully updated port: 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing instance network info cache due to event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updated VIF entry in instance network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5813f64a-e945-4f10-9237-32112b812d6a req-4521c37b-7a89-4974-88b5-3a8a1d63c141 service nova] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance network_info: |[{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start _get_guest_xml network_info=[{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:13:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:13:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6OZv3jXGf9epEXTqvTWh5SlTGZYuKu1FF6p84uy4zPjNDLiSBKdS5r9Our+gDCpFZls95eThzT9NIZNIyU5wQe163AbQfRGBKOk3p8cIG5pfkPPikDcui/JPqG5/LJDg==',key_name='tempest-keypair-362163077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_devices' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:13:50 user nova-compute[75051]:   <uuid>93812981-7340-4edb-9687-008c40475bf9</uuid>
Nov 24 19:13:50 user nova-compute[75051]:   <name>instance-00000022</name>
Nov 24 19:13:50 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:13:50 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:13:50 user nova-compute[75051]:   <metadata>
Nov 24 19:13:50 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:13:50 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1452222332</nova:name>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:13:50</nova:creationTime>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:13:50 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:13:50 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:owner>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:user uuid="b2c20e8819f346e8b5c57a77becb0c68">tempest-AttachVolumeShelveTestJSON-1174395931-project-member</nova:user>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:project uuid="6cc3182a5d4540cfab6a2a919f79f3b9">tempest-AttachVolumeShelveTestJSON-1174395931</nova:project>
Nov 24 19:13:50 user nova-compute[75051]:       </nova:owner>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:13:50 user nova-compute[75051]:       <nova:ports>
Nov 24 19:13:50 user nova-compute[75051]:         <nova:port uuid="7ff3f80c-a6c8-41d9-89e3-9f6121a76640">
Nov 24 19:13:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:13:50 user nova-compute[75051]:         </nova:port>
Nov 24 19:13:50 user nova-compute[75051]:       </nova:ports>
Nov 24 19:13:50 user nova-compute[75051]:     </nova:instance>
Nov 24 19:13:50 user nova-compute[75051]:   </metadata>
Nov 24 19:13:50 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:13:50 user nova-compute[75051]:     <system>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="serial">93812981-7340-4edb-9687-008c40475bf9</entry>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="uuid">93812981-7340-4edb-9687-008c40475bf9</entry>
Nov 24 19:13:50 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:13:50 user nova-compute[75051]:     </system>
Nov 24 19:13:50 user nova-compute[75051]:   </sysinfo>
Nov 24 19:13:50 user nova-compute[75051]:   <os>
Nov 24 19:13:50 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:13:50 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:13:50 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:13:50 user nova-compute[75051]:   </os>
Nov 24 19:13:50 user nova-compute[75051]:   <features>
Nov 24 19:13:50 user nova-compute[75051]:     <acpi/>
Nov 24 19:13:50 user nova-compute[75051]:     <apic/>
Nov 24 19:13:50 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:13:50 user nova-compute[75051]:   </features>
Nov 24 19:13:50 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:13:50 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:13:50 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:13:50 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:13:50 user nova-compute[75051]:   </clock>
Nov 24 19:13:50 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:13:50 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:13:50 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:13:50 user nova-compute[75051]:   </cpu>
Nov 24 19:13:50 user nova-compute[75051]:   <devices>
Nov 24 19:13:50 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:13:50 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:13:50 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk"/>
Nov 24 19:13:50 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:13:50 user nova-compute[75051]:     </disk>
Nov 24 19:13:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:13:50 user nova-compute[75051]:       <mac address="fa:16:3e:e1:2d:57"/>
Nov 24 19:13:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:13:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:13:50 user nova-compute[75051]:       <target dev="tap7ff3f80c-a6"/>
Nov 24 19:13:50 user nova-compute[75051]:     </interface>
Nov 24 19:13:50 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:13:50 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/console.log" append="off"/>
Nov 24 19:13:50 user nova-compute[75051]:     </serial>
Nov 24 19:13:50 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:13:50 user nova-compute[75051]:     <video>
Nov 24 19:13:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:13:50 user nova-compute[75051]:     </video>
Nov 24 19:13:50 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:13:50 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:13:50 user nova-compute[75051]:     </rng>
Nov 24 19:13:50 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:13:50 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:13:50 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:13:50 user nova-compute[75051]:     </memballoon>
Nov 24 19:13:50 user nova-compute[75051]:   </devices>
Nov 24 19:13:50 user nova-compute[75051]: </domain>
Nov 24 19:13:50 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6OZv3jXGf9epEXTqvTWh5SlTGZYuKu1FF6p84uy4zPjNDLiSBKdS5r9Our+gDCpFZls95eThzT9NIZNIyU5wQe163AbQfRGBKOk3p8cIG5pfkPPikDcui/JPqG5/LJDg==',key_name='tempest-keypair-362163077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG os_vif [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94cbac94-f8c4-572e-9255-8bcb647c555b', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff3f80c-a6, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ff3f80c-a6, col_values=(('qos', UUID('891bc29f-a65e-4862-9bde-0f258aa86837')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ff3f80c-a6, col_values=(('external_ids', {'iface-id': '7ff3f80c-a6c8-41d9-89e3-9f6121a76640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:2d:57', 'vm-uuid': '93812981-7340-4edb-9687-008c40475bf9'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing instance network info cache due to event network-changed-edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] Acquiring lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] Acquired lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Refreshing network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:50 user nova-compute[75051]: INFO os_vif [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6')
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No VIF found with MAC fa:16:3e:e1:2d:57, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:50 user nova-compute[75051]: INFO nova.compute.manager [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Detaching volume 19dbcaf4-bd84-41f1-8364-0ff673b1074d
Nov 24 19:13:50 user nova-compute[75051]: INFO nova.virt.block_device [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Attempting to driver detach volume 19dbcaf4-bd84-41f1-8364-0ff673b1074d from mountpoint /dev/vdb
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Attempting to detach device vdb from instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:13:50 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:13:50 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:13:50 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:13:50 user nova-compute[75051]:   <serial>19dbcaf4-bd84-41f1-8364-0ff673b1074d</serial>
Nov 24 19:13:50 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:13:50 user nova-compute[75051]: </disk>
Nov 24 19:13:50 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:13:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully detached device vdb from instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 from the persistent domain config.
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:13:50 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:13:50 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:13:50 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:13:50 user nova-compute[75051]:   <serial>19dbcaf4-bd84-41f1-8364-0ff673b1074d</serial>
Nov 24 19:13:50 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:13:50 user nova-compute[75051]: </disk>
Nov 24 19:13:50 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updated VIF entry in instance network info cache for port edacc8ca-5696-459f-8b16-c0f112cfe689. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [{"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updated VIF entry in instance network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3115a24f-a6e9-4c03-a720-50befaa0468a req-efc3330d-9d2f-44a5-a24b-da86d16b267e service nova] Releasing lock "refresh_cache-3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:13:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ef895f81-e584-406a-83fd-2f643228ec2f req-567a48b8-b9b5-481e-b243-2f378fc3dae2 service nova] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:13:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:13:52 user nova-compute[75051]: WARNING nova.compute.manager [req-842babee-02ad-4133-8fb5-b772d14b56a8 req-ffc3151b-2a34-4ef6-b852-c961059107ed service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state building and task_state spawning.
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:53 user nova-compute[75051]: INFO nova.compute.manager [None req-7e41160f-1cf7-4059-9856-b63d91f7ba5e tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Get console output
Nov 24 19:13:53 user nova-compute[75051]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:13:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance spawned successfully.
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:13:54 user nova-compute[75051]: WARNING nova.compute.manager [req-36e33ce3-a1c7-4edd-a836-f39c24a64e1f req-cd64a315-39f6-4bbd-9a2a-e462956a927f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state building and task_state spawning.
Nov 24 19:13:54 user nova-compute[75051]: INFO nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 24 19:13:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:13:54 user nova-compute[75051]: INFO nova.compute.manager [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Took 6.14 seconds to build instance.
Nov 24 19:13:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-adf0ac9d-3cb5-4440-8777-b0b27c02d645 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.258s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:13:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:13:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:11 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 is timed out.
Nov 24 19:14:11 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully detached device vdb from instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 from the live domain config.
Nov 24 19:14:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KTsuEiOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:14:11 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[39362e75-3563-4f87-b265-15d21e56dc35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:14:11 user nova-compute[75051]: No targets found.
Nov 24 19:14:11 user nova-compute[75051]: iSNS:
Nov 24 19:14:11 user nova-compute[75051]: No targets found.
Nov 24 19:14:11 user nova-compute[75051]: STATIC:
Nov 24 19:14:11 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d
Nov 24 19:14:11 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:14:11 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:14:11 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:14:11 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:14:11 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:14:11 user nova-compute[75051]: FIRMWARE:
Nov 24 19:14:11 user nova-compute[75051]: No targets found.
Nov 24 19:14:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:14:11 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:14:11 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a854afce-78ca-4257-80a6-ba776e662718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd3728-f647-4741-a734-22a58592ce33]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:14:11 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:14:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:14:11 user nova-compute[75051]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d (non-flash)
Nov 24 19:14:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c01a2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62795855-9815-493a-9d50-3f1e0c0e4190]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4615cb8e-2c0c-4a73-b56a-f6a24f0abc43]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bab614-3327-41cd-883e-7c361ca084fd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b4fd11-f0a3-4fe3-a21b-cc13eff86636]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a9c1a-c1d3-4a78-8bb0-8fb7085a75cb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[77266350-01da-413a-afee-965c559a0ea9]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260]
Nov 24 19:14:11 user nova-compute[75051]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d, portal: 172.16.0.220,3260] successful.
Nov 24 19:14:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19dbcaf4-bd84-41f1-8364-0ff673b1074d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f382d5b-6824-4a21-a37d-677e0341c16e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== disconnect_volume: return (282ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:14:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:14:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cd08374f-537d-4772-84ab-3977ae800d6c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.137s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:14:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:19 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:20 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:21 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:14:21 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:14:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8463MB free_disk=25.27145004272461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 93812981-7340-4edb-9687-008c40475bf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [{"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:14:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:44 user nova-compute[75051]: INFO nova.compute.manager [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Terminating instance
Nov 24 19:14:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-8d1a3c10-c21e-4b51-8642-709003760d18 req-6c122043-7b5a-4f25-8f5e-6362e5d50b38 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-unplugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:14:45 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Instance destroyed successfully.
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'resources' on Instance uuid 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-698835302',display_name='tempest-TestMinimumBasicScenario-server-698835302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-698835302',id=33,image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqq4aJMTCtAsdiy66h6QznjUj410RN7eePBQBYnJ6n17jMtcqX0a5BQIkZZ29l1jEPz6j5/QzMPC3vsBqw6RfcsErFmj0eI3vXSzzXolzkOSDLbOMc24AW8qqbIwk6HsQ==',key_name='tempest-TestMinimumBasicScenario-346969746',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:09:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-takjckvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='764ddaee-2c61-4346-ac4a-d58246fabd96',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:12:06Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=3d3f52c0-dfa7-496c-9c7a-bc56e76794c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "edacc8ca-5696-459f-8b16-c0f112cfe689", "address": "fa:16:3e:f1:8b:32", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedacc8ca-56", "ovs_interfaceid": "edacc8ca-5696-459f-8b16-c0f112cfe689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG os_vif [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedacc8ca-56, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c1a7ce8-31d7-4d58-b14c-cbb918d47bad) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:45 user nova-compute[75051]: INFO os_vif [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:8b:32,bridge_name='br-int',has_traffic_filtering=True,id=edacc8ca-5696-459f-8b16-c0f112cfe689,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedacc8ca-56')
Nov 24 19:14:45 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Deleting instance files /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8_del
Nov 24 19:14:45 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Deletion of /opt/stack/data/nova/instances/3d3f52c0-dfa7-496c-9c7a-bc56e76794c8_del complete
Nov 24 19:14:45 user nova-compute[75051]: INFO nova.compute.manager [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 19:14:45 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:14:45 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Took 0.45 seconds to deallocate network for instance.
Nov 24 19:14:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-e760ac74-2edb-4734-b2a0-edf3bb99098f req-11174848-9181-49a7-bc53-ea35b3ad963f service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-deleted-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:46 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Deleted allocations for instance 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8
Nov 24 19:14:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e8fb07d2-043b-4683-bd03-41ad287b3442 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] Acquiring lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] Lock "3d3f52c0-dfa7-496c-9c7a-bc56e76794c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] No waiting events found dispatching network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:46 user nova-compute[75051]: WARNING nova.compute.manager [req-8ce258d1-68b4-4546-9356-7e5d478c16f6 req-b7abb89d-e428-4248-b725-d77a54d3fd28 service nova] [instance: 3d3f52c0-dfa7-496c-9c7a-bc56e76794c8] Received unexpected event network-vif-plugged-edacc8ca-5696-459f-8b16-c0f112cfe689 for instance with vm_state deleted and task_state None.
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'info_cache' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:14:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance destroyed successfully.
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'resources' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG os_vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0930de9a-90, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d344429d-4e2d-4125-871e-260d0d00dc86) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:48 user nova-compute[75051]: INFO os_vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start _get_guest_xml network_info=[{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:48 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:14:48 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:14:48 user nova-compute[75051]:   <uuid>0a4bd91d-ace4-41e5-a9e6-0dd291622b45</uuid>
Nov 24 19:14:48 user nova-compute[75051]:   <name>instance-0000001f</name>
Nov 24 19:14:48 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:14:48 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:14:48 user nova-compute[75051]:   <metadata>
Nov 24 19:14:48 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:14:48 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeTestJSON-server-1975778758</nova:name>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:14:48</nova:creationTime>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:14:48 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:14:48 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:owner>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:user uuid="623c9f272b0e44f1a14364d1f90fc762">tempest-AttachVolumeTestJSON-866610194-project-member</nova:user>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:project uuid="2c07aa581fa647a39092777af5ee366d">tempest-AttachVolumeTestJSON-866610194</nova:project>
Nov 24 19:14:48 user nova-compute[75051]:       </nova:owner>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:14:48 user nova-compute[75051]:       <nova:ports>
Nov 24 19:14:48 user nova-compute[75051]:         <nova:port uuid="0930de9a-909c-4368-8b12-b7d3c8ee618f">
Nov 24 19:14:48 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:14:48 user nova-compute[75051]:         </nova:port>
Nov 24 19:14:48 user nova-compute[75051]:       </nova:ports>
Nov 24 19:14:48 user nova-compute[75051]:     </nova:instance>
Nov 24 19:14:48 user nova-compute[75051]:   </metadata>
Nov 24 19:14:48 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:14:48 user nova-compute[75051]:     <system>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="serial">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="uuid">0a4bd91d-ace4-41e5-a9e6-0dd291622b45</entry>
Nov 24 19:14:48 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:14:48 user nova-compute[75051]:     </system>
Nov 24 19:14:48 user nova-compute[75051]:   </sysinfo>
Nov 24 19:14:48 user nova-compute[75051]:   <os>
Nov 24 19:14:48 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:14:48 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:14:48 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:14:48 user nova-compute[75051]:   </os>
Nov 24 19:14:48 user nova-compute[75051]:   <features>
Nov 24 19:14:48 user nova-compute[75051]:     <acpi/>
Nov 24 19:14:48 user nova-compute[75051]:     <apic/>
Nov 24 19:14:48 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:14:48 user nova-compute[75051]:   </features>
Nov 24 19:14:48 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:14:48 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:14:48 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:14:48 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:14:48 user nova-compute[75051]:   </clock>
Nov 24 19:14:48 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:14:48 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:14:48 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:14:48 user nova-compute[75051]:   </cpu>
Nov 24 19:14:48 user nova-compute[75051]:   <devices>
Nov 24 19:14:48 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:14:48 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:14:48 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk"/>
Nov 24 19:14:48 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:14:48 user nova-compute[75051]:     </disk>
Nov 24 19:14:48 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:14:48 user nova-compute[75051]:       <mac address="fa:16:3e:24:4c:23"/>
Nov 24 19:14:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:14:48 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:14:48 user nova-compute[75051]:       <target dev="tap0930de9a-90"/>
Nov 24 19:14:48 user nova-compute[75051]:     </interface>
Nov 24 19:14:48 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:14:48 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/console.log" append="off"/>
Nov 24 19:14:48 user nova-compute[75051]:     </serial>
Nov 24 19:14:48 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:14:48 user nova-compute[75051]:     <video>
Nov 24 19:14:48 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:14:48 user nova-compute[75051]:     </video>
Nov 24 19:14:48 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:14:48 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:14:48 user nova-compute[75051]:     </rng>
Nov 24 19:14:48 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:14:48 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:14:48 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:14:48 user nova-compute[75051]:     </memballoon>
Nov 24 19:14:48 user nova-compute[75051]:   </devices>
Nov 24 19:14:48 user nova-compute[75051]: </domain>
Nov 24 19:14:48 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:14:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Cannot resize image /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'migration_context' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.objects.base [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Object Instance<0a4bd91d-ace4-41e5-a9e6-0dd291622b45> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG os_vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ad121a9-3af1-50d2-bcb4-be901984de95', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0930de9a-90, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0930de9a-90, col_values=(('qos', UUID('54c2ddae-9e14-4c39-951d-c514acd8cdee')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0930de9a-90, col_values=(('external_ids', {'iface-id': '0930de9a-909c-4368-8b12-b7d3c8ee618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:4c:23', 'vm-uuid': '0a4bd91d-ace4-41e5-a9e6-0dd291622b45'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:49 user nova-compute[75051]: INFO os_vif [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:14:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:51 user nova-compute[75051]: WARNING nova.compute.manager [req-c5d2dec8-892b-4e15-a64e-0138f3c06de4 req-08eaee29-9c85-46ba-b1d2-27b5e56bb1a2 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state stopped and task_state powering-on.
Nov 24 19:14:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:14:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance rebooted successfully.
Nov 24 19:14:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-34157349-8c56-4d57-b9d4-468b476b5033 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:53 user nova-compute[75051]: WARNING nova.compute.manager [req-d36484a7-139e-46ad-9ad2-e0859a36e414 req-d56d8ec5-1ff3-4eb1-9433-c524ca2c24ee service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state active and task_state None.
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:53 user nova-compute[75051]: INFO nova.compute.manager [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Terminating instance
Nov 24 19:14:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-8961a625-08a2-4cb0-b0ec-10432320babc req-7697ad67-428b-40bf-956e-c7027ac8a625 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-unplugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Instance destroyed successfully.
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'resources' on Instance uuid 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-271988235',display_name='tempest-ServerActionsTestOtherA-server-271988235',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-271988235',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:10:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-mj6v0s97',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=6a9e43fd-eda8-4d2c-aa58-555dafb1a58e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "address": "fa:16:3e:9b:6e:8a", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c1e144-62", "ovs_interfaceid": "64c1e144-62f9-4d97-96fb-1ab66a6016e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_vif [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c1e144-62, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e1d5b46-155e-4a89-a750-a7154f6e8f2d) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:14:54 user nova-compute[75051]: INFO os_vif [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6e:8a,bridge_name='br-int',has_traffic_filtering=True,id=64c1e144-62f9-4d97-96fb-1ab66a6016e5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c1e144-62')
Nov 24 19:14:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eGoPvXQC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:14:54 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e991c-f194-4c0f-af01-6dddcbaa8018]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:14:54 user nova-compute[75051]: No targets found.
Nov 24 19:14:54 user nova-compute[75051]: iSNS:
Nov 24 19:14:54 user nova-compute[75051]: No targets found.
Nov 24 19:14:54 user nova-compute[75051]: STATIC:
Nov 24 19:14:54 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff
Nov 24 19:14:54 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:14:54 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:14:54 user nova-compute[75051]: FIRMWARE:
Nov 24 19:14:54 user nova-compute[75051]: No targets found.
Nov 24 19:14:54 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:14:54 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:14:54 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[594c1828-cfd2-415f-a9f3-d11f738a079a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d7f356-00d7-40cc-824a-d47442df664b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:14:54 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff (non-flash)
Nov 24 19:14:54 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c1671ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e86e01e-528d-43f7-a96c-8c860cb5ebd5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[643baf0b-a4b8-4369-b5c9-7f3fb33aadca]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cc5e22-712f-43e4-8f41-31d2e2dd91ec]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8211c3-1695-4171-82c7-d679696d9fd0]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3436fec7-c39bfa71cd17d1a4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3436fec7', '/dev/disk/by-id/scsi-26333396266613731') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d777666-b5e6-4308-870b-b9b1ce574ebb]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39122c6-5793-4f2b-87e7-1d4019dfefaf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075d406-1740-4e28-9202-5e434e8cceba]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260]
Nov 24 19:14:55 user nova-compute[75051]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff, portal: 172.16.0.220,3260] successful.
Nov 24 19:14:55 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:685790db-ad8b-4088-9115-3e0e64273dff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2160b7a-30d6-4971-b3f5-b8896634715e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] <== disconnect_volume: return (290ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:14:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Deleting instance files /opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e_del
Nov 24 19:14:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Deletion of /opt/stack/data/nova/instances/6a9e43fd-eda8-4d2c-aa58-555dafb1a58e_del complete
Nov 24 19:14:55 user nova-compute[75051]: INFO nova.compute.manager [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 24 19:14:55 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:14:55 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:14:55 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Took 0.69 seconds to deallocate network for instance.
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] Acquiring lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] No waiting events found dispatching network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:14:56 user nova-compute[75051]: WARNING nova.compute.manager [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received unexpected event network-vif-plugged-64c1e144-62f9-4d97-96fb-1ab66a6016e5 for instance with vm_state active and task_state deleting.
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-fc709914-ae28-40e7-9fff-15d36d481b14 req-669a9702-8645-4153-9ce5-2760b6fd94b4 service nova] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Received event network-vif-deleted-64c1e144-62f9-4d97-96fb-1ab66a6016e5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:14:56 user nova-compute[75051]: INFO nova.compute.manager [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Took 0.83 seconds to detach 1 volumes for instance.
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e] Deleting volume: 685790db-ad8b-4088-9115-3e0e64273dff {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:14:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:56 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Deleted allocations for instance 6a9e43fd-eda8-4d2c-aa58-555dafb1a58e
Nov 24 19:14:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-514832ff-6677-4abc-b6f5-828e8634b082 tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "6a9e43fd-eda8-4d2c-aa58-555dafb1a58e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.115s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:14:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:14:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:15:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:20 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:15:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=25.29755401611328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 93812981-7340-4edb-9687-008c40475bf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:15:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:15:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:15:38 user nova-compute[75051]: INFO nova.compute.claims [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Claim successful on node user
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:15:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.policy [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e7cd8f02d33451dab0dd657dae58e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dd3c174a2f54797b24dba9c5eab26fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:15:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Creating image(s)
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "/opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "/opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "/opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing instance network info cache due to event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Successfully created port: b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.virt.images [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] fce932bd-514d-49d8-9800-cff955564df1 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.part /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.part /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.converted" returned: 0 in 0.240s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updated VIF entry in instance network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05.converted --force-share --output=json" returned: 0 in 0.223s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.130s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1838b55-d058-4b2b-853d-9e67935b6452 req-ffde2f8c-1e90-4863-99d9-090fa776686f service nova] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Successfully updated port: b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing instance network info cache due to event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json" returned: 0 in 0.210s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05,backing_fmt=raw /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05,backing_fmt=raw /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk 1073741824" returned: 0 in 0.053s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "44da7ddaafc480eaeda07a40156fd83c5e249b05" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-57781201-fe7d-4979-bb06-4596445de436 req-d2b4c2f1-3a2c-4067-8426-6e78b4760f58 service nova] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking if we can resize image /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Cannot resize image /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Ensure instance console log exists: /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance network_info: |[{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Start _get_guest_xml network_info=[{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T19:15:36Z,direct_url=<?>,disk_format='qcow2',id=fce932bd-514d-49d8-9800-cff955564df1,min_disk=0,min_ram=0,name='tempest-scenario-img--1374220327',owner='3dd3c174a2f54797b24dba9c5eab26fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T19:15:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': 'fce932bd-514d-49d8-9800-cff955564df1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:15:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:15:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T19:15:36Z,direct_url=<?>,disk_format='qcow2',id=fce932bd-514d-49d8-9800-cff955564df1,min_disk=0,min_ram=0,name='tempest-scenario-img--1374220327',owner='3dd3c174a2f54797b24dba9c5eab26fa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T19:15:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350445351',display_name='tempest-TestMinimumBasicScenario-server-350445351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350445351',id=35,image_ref='fce932bd-514d-49d8-9800-cff955564df1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPbpgWBac6zkHkBpThTOniCqiteq5pxXM3iAtq0neRSVz4gG2yMjZTVm0Rtw4bBj1xgN07uO28iBzp82wI6zypOjHaXVdhUzwcWflJJ45xL1spctEG8Z1oJ+nizl3Bw3A==',key_name='tempest-TestMinimumBasicScenario-538818214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-0fyvqsw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fce932bd-514d-49d8-9800-cff955564df1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:15:39Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=430f20f2-3d8d-452b-a410-c4f05e32d7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'pci_devices' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:15:41 user nova-compute[75051]:   <uuid>430f20f2-3d8d-452b-a410-c4f05e32d7aa</uuid>
Nov 24 19:15:41 user nova-compute[75051]:   <name>instance-00000023</name>
Nov 24 19:15:41 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:15:41 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:15:41 user nova-compute[75051]:   <metadata>
Nov 24 19:15:41 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:15:41 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:name>tempest-TestMinimumBasicScenario-server-350445351</nova:name>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:15:41</nova:creationTime>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:15:41 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:15:41 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:owner>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:user uuid="4e7cd8f02d33451dab0dd657dae58e5e">tempest-TestMinimumBasicScenario-351181186-project-member</nova:user>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:project uuid="3dd3c174a2f54797b24dba9c5eab26fa">tempest-TestMinimumBasicScenario-351181186</nova:project>
Nov 24 19:15:41 user nova-compute[75051]:       </nova:owner>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:root type="image" uuid="fce932bd-514d-49d8-9800-cff955564df1"/>
Nov 24 19:15:41 user nova-compute[75051]:       <nova:ports>
Nov 24 19:15:41 user nova-compute[75051]:         <nova:port uuid="b7b40a71-9e06-4179-9167-c86bdcbf8518">
Nov 24 19:15:41 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 24 19:15:41 user nova-compute[75051]:         </nova:port>
Nov 24 19:15:41 user nova-compute[75051]:       </nova:ports>
Nov 24 19:15:41 user nova-compute[75051]:     </nova:instance>
Nov 24 19:15:41 user nova-compute[75051]:   </metadata>
Nov 24 19:15:41 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:15:41 user nova-compute[75051]:     <system>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="serial">430f20f2-3d8d-452b-a410-c4f05e32d7aa</entry>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="uuid">430f20f2-3d8d-452b-a410-c4f05e32d7aa</entry>
Nov 24 19:15:41 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:15:41 user nova-compute[75051]:     </system>
Nov 24 19:15:41 user nova-compute[75051]:   </sysinfo>
Nov 24 19:15:41 user nova-compute[75051]:   <os>
Nov 24 19:15:41 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:15:41 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:15:41 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:15:41 user nova-compute[75051]:   </os>
Nov 24 19:15:41 user nova-compute[75051]:   <features>
Nov 24 19:15:41 user nova-compute[75051]:     <acpi/>
Nov 24 19:15:41 user nova-compute[75051]:     <apic/>
Nov 24 19:15:41 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:15:41 user nova-compute[75051]:   </features>
Nov 24 19:15:41 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:15:41 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:15:41 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:15:41 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:15:41 user nova-compute[75051]:   </clock>
Nov 24 19:15:41 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:15:41 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:15:41 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:15:41 user nova-compute[75051]:   </cpu>
Nov 24 19:15:41 user nova-compute[75051]:   <devices>
Nov 24 19:15:41 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:15:41 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:15:41 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk"/>
Nov 24 19:15:41 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:15:41 user nova-compute[75051]:     </disk>
Nov 24 19:15:41 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:15:41 user nova-compute[75051]:       <mac address="fa:16:3e:38:ce:7b"/>
Nov 24 19:15:41 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:15:41 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:15:41 user nova-compute[75051]:       <target dev="tapb7b40a71-9e"/>
Nov 24 19:15:41 user nova-compute[75051]:     </interface>
Nov 24 19:15:41 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:15:41 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/console.log" append="off"/>
Nov 24 19:15:41 user nova-compute[75051]:     </serial>
Nov 24 19:15:41 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:15:41 user nova-compute[75051]:     <video>
Nov 24 19:15:41 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:15:41 user nova-compute[75051]:     </video>
Nov 24 19:15:41 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:15:41 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:15:41 user nova-compute[75051]:     </rng>
Nov 24 19:15:41 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:15:41 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:15:41 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:15:41 user nova-compute[75051]:     </memballoon>
Nov 24 19:15:41 user nova-compute[75051]:   </devices>
Nov 24 19:15:41 user nova-compute[75051]: </domain>
Nov 24 19:15:41 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350445351',display_name='tempest-TestMinimumBasicScenario-server-350445351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350445351',id=35,image_ref='fce932bd-514d-49d8-9800-cff955564df1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPbpgWBac6zkHkBpThTOniCqiteq5pxXM3iAtq0neRSVz4gG2yMjZTVm0Rtw4bBj1xgN07uO28iBzp82wI6zypOjHaXVdhUzwcWflJJ45xL1spctEG8Z1oJ+nizl3Bw3A==',key_name='tempest-TestMinimumBasicScenario-538818214',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-0fyvqsw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fce932bd-514d-49d8-9800-cff955564df1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:15:39Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=430f20f2-3d8d-452b-a410-c4f05e32d7aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG os_vif [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fafce85e-e0a2-51d6-8785-bedd4b09cb0b', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b40a71-9e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7b40a71-9e, col_values=(('qos', UUID('b6eb5852-4468-43eb-98c6-c0d32f087d06')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7b40a71-9e, col_values=(('external_ids', {'iface-id': 'b7b40a71-9e06-4179-9167-c86bdcbf8518', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:ce:7b', 'vm-uuid': '430f20f2-3d8d-452b-a410-c4f05e32d7aa'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:41 user nova-compute[75051]: INFO os_vif [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e')
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:15:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No VIF found with MAC fa:16:3e:38:ce:7b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:42 user nova-compute[75051]: WARNING nova.compute.manager [req-89098d0f-9f5c-41b5-8bd4-637456243aee req-2e572807-b471-4a5a-881c-e09b2a74d1e5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state building and task_state spawning.
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:43 user nova-compute[75051]: INFO nova.compute.manager [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Shelving
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance destroyed successfully.
Nov 24 19:15:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Beginning cold snapshot process
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk /opt/stack/data/nova/instances/snapshots/tmp5he9_w0i/29a717ca56234f74bb486435657a9d1c {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:15:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance spawned successfully.
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:44 user nova-compute[75051]: WARNING nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state building and task_state spawning.
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:44 user nova-compute[75051]: WARNING nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:44 user nova-compute[75051]: WARNING nova.compute.manager [req-ea32ab94-1aec-442a-a07a-dc8b1a771c32 req-9f2c61f9-3750-49a0-9216-96903adaddba service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 24 19:15:44 user nova-compute[75051]: INFO nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 24 19:15:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:15:45 user nova-compute[75051]: INFO nova.compute.manager [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Took 6.75 seconds to build instance.
Nov 24 19:15:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-cf16eb3d-efcf-4973-90a8-a9771f2c1293 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.872s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk /opt/stack/data/nova/instances/snapshots/tmp5he9_w0i/29a717ca56234f74bb486435657a9d1c" returned: 0 in 0.824s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:15:45 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Snapshot extracted, beginning image upload
Nov 24 19:15:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Snapshot image upload complete
Nov 24 19:15:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:47 user nova-compute[75051]: INFO nova.compute.manager [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Terminating instance
Nov 24 19:15:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:15:47 user nova-compute[75051]: INFO nova.compute.manager [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Shelve offloading
Nov 24 19:15:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance destroyed successfully.
Nov 24 19:15:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Instance destroyed successfully.
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lazy-loading 'resources' on Instance uuid 563ea966-1ba6-4c4d-9d01-c5293e2d6d19 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T18:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1613468970',display_name='tempest-ServerActionsTestOtherA-server-1613468970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1613468970',id=15,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+YJNonz9b53Z39xTPmugEtxZQHsU5MxFKu81m1MSPFE5AInNo1RObC4kh8Pc9/7omj4hM31p2xiuVeAbAlXRTBWJ1ijMed/pgj6eR8bL+zdWnwIH/ZWojwiuaecinmkQ==',key_name='tempest-keypair-1032356312',keypairs=<?>,launch_index=0,launched_at=2023-11-24T18:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ae5e7665a994fe29c206c1b53c5359f',ramdisk_id='',reservation_id='r-fv3h0xhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-214702841',owner_user_name='tempest-ServerActionsTestOtherA-214702841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T18:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1542a899903c40dfba0d4b274b547b73',uuid=563ea966-1ba6-4c4d-9d01-c5293e2d6d19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converting VIF {"id": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "address": "fa:16:3e:ce:43:f2", "network": {"id": "7b2192b0-1bfe-458f-906b-691256e3616a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1104042268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ae5e7665a994fe29c206c1b53c5359f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1eb287e-95", "ovs_interfaceid": "f1eb287e-95db-4df1-87fe-cf8738161dd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG os_vif [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1eb287e-95, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db41ea83-7f84-4f4b-8a39-f4cff901f872) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: INFO os_vif [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:43:f2,bridge_name='br-int',has_traffic_filtering=True,id=f1eb287e-95db-4df1-87fe-cf8738161dd5,network=Network(7b2192b0-1bfe-458f-906b-691256e3616a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1eb287e-95')
Nov 24 19:15:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Deleting instance files /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19_del
Nov 24 19:15:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Deletion of /opt/stack/data/nova/instances/563ea966-1ba6-4c4d-9d01-c5293e2d6d19_del complete
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-unplugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] No waiting events found dispatching network-vif-unplugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-f806a87f-b87f-4d27-915b-1f6a315c2371 req-ca6e12d8-61fe-4562-bb95-5f0613a87aac service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-unplugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:15:48 user nova-compute[75051]: INFO nova.compute.manager [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 24 19:15:48 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:15:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance destroyed successfully.
Nov 24 19:15:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'resources' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6OZv3jXGf9epEXTqvTWh5SlTGZYuKu1FF6p84uy4zPjNDLiSBKdS5r9Our+gDCpFZls95eThzT9NIZNIyU5wQe163AbQfRGBKOk3p8cIG5pfkPPikDcui/JPqG5/LJDg==',key_name='tempest-keypair-362163077',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:15:47.719060',shelved_host='user',shelved_image_id='8bb2db0f-e128-458e-84c4-c6a8cacff307'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:15:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG os_vif [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing instance network info cache due to event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff3f80c-a6, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=891bc29f-a65e-4862-9bde-0f258aa86837) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:49 user nova-compute[75051]: INFO os_vif [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6')
Nov 24 19:15:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Deleting instance files /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9_del
Nov 24 19:15:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Deletion of /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9_del complete
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:49 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Took 0.80 seconds to deallocate network for instance.
Nov 24 19:15:49 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Deleted allocations for instance 93812981-7340-4edb-9687-008c40475bf9
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updated VIF entry in instance network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7b1b5c30-f3fd-42f4-a6e1-51bb674a6079 req-4b825535-7daf-40b0-a8ab-a0c9af823058 service nova] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.148s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'numa_topology' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.objects.base [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<93812981-7340-4edb-9687-008c40475bf9> lazy-loaded attributes: resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:15:49 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Deleted allocations for instance 563ea966-1ba6-4c4d-9d01-c5293e2d6d19
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c8299a22-953b-4b43-8997-6a0a07ae35ac tempest-ServerActionsTestOtherA-214702841 tempest-ServerActionsTestOtherA-214702841-project-member] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ee813661-bae1-4f59-917d-b12c868c8b18 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.377s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] Acquiring lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:15:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:15:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] Lock "563ea966-1ba6-4c4d-9d01-c5293e2d6d19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:15:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] No waiting events found dispatching network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:15:50 user nova-compute[75051]: WARNING nova.compute.manager [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received unexpected event network-vif-plugged-f1eb287e-95db-4df1-87fe-cf8738161dd5 for instance with vm_state deleted and task_state None.
Nov 24 19:15:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-b95bdc39-e431-4655-a6ac-d76637a4c7b0 req-0ec3663f-b5ad-45e4-a6a3-c62500496b5b service nova] [instance: 563ea966-1ba6-4c4d-9d01-c5293e2d6d19] Received event network-vif-deleted-f1eb287e-95db-4df1-87fe-cf8738161dd5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:15:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:15:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:15:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:19 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:16:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:21 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.253650665283203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:16:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:16:28 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [{"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-0a4bd91d-ace4-41e5-a9e6-0dd291622b45" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:16:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:34 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:39 user nova-compute[75051]: INFO nova.compute.manager [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Terminating instance
Nov 24 19:16:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-9f0e68f0-ced3-4cb9-9c29-ffad95b16013 req-88cc7dc2-0f8a-4bb4-8f53-1d1c2bb5775b service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-unplugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:16:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Instance destroyed successfully.
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'resources' on Instance uuid 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1975778758',display_name='tempest-AttachVolumeTestJSON-server-1975778758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1975778758',id=31,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEH8xsDtNFZZR2Wnzl+53g9CmbFP4OFmleSOuGMDmcw0p5roMiEOy4aBFTO9TJCEsonhp+S+/Cj5IRaBhXancJk6xwTL9d80vWO1vXuQLgfId4jFAyVmonUE1nyiH9bQiA==',key_name='tempest-keypair-1327389937',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-2r82qlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=0a4bd91d-ace4-41e5-a9e6-0dd291622b45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "address": "fa:16:3e:24:4c:23", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0930de9a-90", "ovs_interfaceid": "0930de9a-909c-4368-8b12-b7d3c8ee618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG os_vif [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0930de9a-90, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54c2ddae-9e14-4c39-951d-c514acd8cdee) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:40 user nova-compute[75051]: INFO os_vif [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:4c:23,bridge_name='br-int',has_traffic_filtering=True,id=0930de9a-909c-4368-8b12-b7d3c8ee618f,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0930de9a-90')
Nov 24 19:16:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Deleting instance files /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45_del
Nov 24 19:16:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Deletion of /opt/stack/data/nova/instances/0a4bd91d-ace4-41e5-a9e6-0dd291622b45_del complete
Nov 24 19:16:40 user nova-compute[75051]: INFO nova.compute.manager [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 19:16:40 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:16:40 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:41 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Took 1.00 seconds to deallocate network for instance.
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-0bf26f73-1c57-43d0-b000-0f1e56172b49 req-7cc8d6e4-81ee-42e3-ae31-7883f8fa9fe8 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-deleted-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:41 user nova-compute[75051]: INFO nova.compute.manager [req-0bf26f73-1c57-43d0-b000-0f1e56172b49 req-7cc8d6e4-81ee-42e3-ae31-7883f8fa9fe8 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Neutron deleted interface 0930de9a-909c-4368-8b12-b7d3c8ee618f; detaching it from the instance and deleting it from the info cache
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.network.neutron [req-0bf26f73-1c57-43d0-b000-0f1e56172b49 req-7cc8d6e4-81ee-42e3-ae31-7883f8fa9fe8 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-0bf26f73-1c57-43d0-b000-0f1e56172b49 req-7cc8d6e4-81ee-42e3-ae31-7883f8fa9fe8 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Detach interface failed, port_id=0930de9a-909c-4368-8b12-b7d3c8ee618f, reason: Instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:41 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Deleted allocations for instance 0a4bd91d-ace4-41e5-a9e6-0dd291622b45
Nov 24 19:16:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fbcffc90-32b7-46d3-8a53-a9d81a206e69 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] Acquiring lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] Lock "0a4bd91d-ace4-41e5-a9e6-0dd291622b45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] No waiting events found dispatching network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:41 user nova-compute[75051]: WARNING nova.compute.manager [req-3c2ea518-ceaf-47b5-94bd-c1a0c565f22a req-d295db4b-9074-49b5-8a71-f064bec6e0d1 service nova] [instance: 0a4bd91d-ace4-41e5-a9e6-0dd291622b45] Received unexpected event network-vif-plugged-0930de9a-909c-4368-8b12-b7d3c8ee618f for instance with vm_state deleted and task_state None.
Nov 24 19:16:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:16:49 user nova-compute[75051]: INFO nova.compute.claims [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Claim successful on node user
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:16:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:16:49 user nova-compute[75051]: DEBUG nova.policy [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37067adbbf3746ccb3aa3ad60b617217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6b1989d844cd49bb0a70f2d52e309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:16:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Creating image(s)
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:16:50 user nova-compute[75051]: INFO nova.compute.claims [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Claim successful on node user
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk 1073741824" returned: 0 in 0.060s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Successfully created port: 350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:16:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.policy [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37067adbbf3746ccb3aa3ad60b617217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6b1989d844cd49bb0a70f2d52e309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Cannot resize image /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Ensure instance console log exists: /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:16:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Creating image(s)
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Successfully updated port: 350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-changed-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Refreshing instance network info cache due to event network-changed-350e9cdb-e02f-41cc-853f-50b905a93655. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk 1073741824" returned: 0 in 0.060s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Successfully created port: cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance network_info: |[{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Refreshing network info cache for port 350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start _get_guest_xml network_info=[{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:16:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-868253231',display_name='tempest-ServerRescueNegativeTestJSON-server-868253231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-868253231',id=36,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-hqfjo7lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:50Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=7efb1743-512a-4bda-9930-b03c160b98f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:16:51 user nova-compute[75051]:   <uuid>7efb1743-512a-4bda-9930-b03c160b98f6</uuid>
Nov 24 19:16:51 user nova-compute[75051]:   <name>instance-00000024</name>
Nov 24 19:16:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:16:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:16:51 user nova-compute[75051]:   <metadata>
Nov 24 19:16:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:16:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-868253231</nova:name>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:16:51</nova:creationTime>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:16:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:16:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:owner>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:16:51 user nova-compute[75051]:       </nova:owner>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:16:51 user nova-compute[75051]:       <nova:ports>
Nov 24 19:16:51 user nova-compute[75051]:         <nova:port uuid="350e9cdb-e02f-41cc-853f-50b905a93655">
Nov 24 19:16:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 19:16:51 user nova-compute[75051]:         </nova:port>
Nov 24 19:16:51 user nova-compute[75051]:       </nova:ports>
Nov 24 19:16:51 user nova-compute[75051]:     </nova:instance>
Nov 24 19:16:51 user nova-compute[75051]:   </metadata>
Nov 24 19:16:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:16:51 user nova-compute[75051]:     <system>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="serial">7efb1743-512a-4bda-9930-b03c160b98f6</entry>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="uuid">7efb1743-512a-4bda-9930-b03c160b98f6</entry>
Nov 24 19:16:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:16:51 user nova-compute[75051]:     </system>
Nov 24 19:16:51 user nova-compute[75051]:   </sysinfo>
Nov 24 19:16:51 user nova-compute[75051]:   <os>
Nov 24 19:16:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:16:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:16:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:16:51 user nova-compute[75051]:   </os>
Nov 24 19:16:51 user nova-compute[75051]:   <features>
Nov 24 19:16:51 user nova-compute[75051]:     <acpi/>
Nov 24 19:16:51 user nova-compute[75051]:     <apic/>
Nov 24 19:16:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:16:51 user nova-compute[75051]:   </features>
Nov 24 19:16:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:16:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:16:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:16:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:16:51 user nova-compute[75051]:   </clock>
Nov 24 19:16:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:16:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:16:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:16:51 user nova-compute[75051]:   </cpu>
Nov 24 19:16:51 user nova-compute[75051]:   <devices>
Nov 24 19:16:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:16:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:16:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk"/>
Nov 24 19:16:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:16:51 user nova-compute[75051]:     </disk>
Nov 24 19:16:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:16:51 user nova-compute[75051]:       <mac address="fa:16:3e:e2:03:b8"/>
Nov 24 19:16:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:16:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:16:51 user nova-compute[75051]:       <target dev="tap350e9cdb-e0"/>
Nov 24 19:16:51 user nova-compute[75051]:     </interface>
Nov 24 19:16:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:16:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/console.log" append="off"/>
Nov 24 19:16:51 user nova-compute[75051]:     </serial>
Nov 24 19:16:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:16:51 user nova-compute[75051]:     <video>
Nov 24 19:16:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:16:51 user nova-compute[75051]:     </video>
Nov 24 19:16:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:16:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:16:51 user nova-compute[75051]:     </rng>
Nov 24 19:16:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:16:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:16:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:16:51 user nova-compute[75051]:     </memballoon>
Nov 24 19:16:51 user nova-compute[75051]:   </devices>
Nov 24 19:16:51 user nova-compute[75051]: </domain>
Nov 24 19:16:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-868253231',display_name='tempest-ServerRescueNegativeTestJSON-server-868253231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-868253231',id=36,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-hqfjo7lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:50Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=7efb1743-512a-4bda-9930-b03c160b98f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG os_vif [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2d53f63-85b3-5739-8230-2808518e36e5', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Cannot resize image /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Ensure instance console log exists: /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350e9cdb-e0, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap350e9cdb-e0, col_values=(('qos', UUID('bba0ba68-abc6-4151-a800-8493417fe68a')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap350e9cdb-e0, col_values=(('external_ids', {'iface-id': '350e9cdb-e02f-41cc-853f-50b905a93655', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:03:b8', 'vm-uuid': '7efb1743-512a-4bda-9930-b03c160b98f6'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:51 user nova-compute[75051]: INFO os_vif [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0')
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:e2:03:b8, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updated VIF entry in instance network info cache for port 350e9cdb-e02f-41cc-853f-50b905a93655. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:16:51 user nova-compute[75051]: DEBUG nova.network.neutron [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3d999812-bf75-4419-b695-691462589c96 req-4c9824dd-affb-4af7-a8ec-b793f547c11c service nova] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Successfully updated port: cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-changed-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Refreshing instance network info cache due to event network-changed-cf1e8820-01b2-4c72-934e-ef5e5a52874b. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance network_info: |[{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Refreshing network info cache for port cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start _get_guest_xml network_info=[{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:16:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-656798778',display_name='tempest-ServerRescueNegativeTestJSON-server-656798778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-656798778',id=37,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-wclbhxj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:51Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=c314a125-ae40-4829-af87-09288fd1d85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:16:52 user nova-compute[75051]:   <uuid>c314a125-ae40-4829-af87-09288fd1d85a</uuid>
Nov 24 19:16:52 user nova-compute[75051]:   <name>instance-00000025</name>
Nov 24 19:16:52 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:16:52 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:16:52 user nova-compute[75051]:   <metadata>
Nov 24 19:16:52 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:16:52 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-656798778</nova:name>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:16:52</nova:creationTime>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:16:52 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:16:52 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:owner>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:16:52 user nova-compute[75051]:       </nova:owner>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:16:52 user nova-compute[75051]:       <nova:ports>
Nov 24 19:16:52 user nova-compute[75051]:         <nova:port uuid="cf1e8820-01b2-4c72-934e-ef5e5a52874b">
Nov 24 19:16:52 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 19:16:52 user nova-compute[75051]:         </nova:port>
Nov 24 19:16:52 user nova-compute[75051]:       </nova:ports>
Nov 24 19:16:52 user nova-compute[75051]:     </nova:instance>
Nov 24 19:16:52 user nova-compute[75051]:   </metadata>
Nov 24 19:16:52 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:16:52 user nova-compute[75051]:     <system>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="serial">c314a125-ae40-4829-af87-09288fd1d85a</entry>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="uuid">c314a125-ae40-4829-af87-09288fd1d85a</entry>
Nov 24 19:16:52 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:16:52 user nova-compute[75051]:     </system>
Nov 24 19:16:52 user nova-compute[75051]:   </sysinfo>
Nov 24 19:16:52 user nova-compute[75051]:   <os>
Nov 24 19:16:52 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:16:52 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:16:52 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:16:52 user nova-compute[75051]:   </os>
Nov 24 19:16:52 user nova-compute[75051]:   <features>
Nov 24 19:16:52 user nova-compute[75051]:     <acpi/>
Nov 24 19:16:52 user nova-compute[75051]:     <apic/>
Nov 24 19:16:52 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:16:52 user nova-compute[75051]:   </features>
Nov 24 19:16:52 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:16:52 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:16:52 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:16:52 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:16:52 user nova-compute[75051]:   </clock>
Nov 24 19:16:52 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:16:52 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:16:52 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:16:52 user nova-compute[75051]:   </cpu>
Nov 24 19:16:52 user nova-compute[75051]:   <devices>
Nov 24 19:16:52 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:16:52 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:16:52 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk"/>
Nov 24 19:16:52 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:16:52 user nova-compute[75051]:     </disk>
Nov 24 19:16:52 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:16:52 user nova-compute[75051]:       <mac address="fa:16:3e:13:dc:c7"/>
Nov 24 19:16:52 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:16:52 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:16:52 user nova-compute[75051]:       <target dev="tapcf1e8820-01"/>
Nov 24 19:16:52 user nova-compute[75051]:     </interface>
Nov 24 19:16:52 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:16:52 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/console.log" append="off"/>
Nov 24 19:16:52 user nova-compute[75051]:     </serial>
Nov 24 19:16:52 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:16:52 user nova-compute[75051]:     <video>
Nov 24 19:16:52 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:16:52 user nova-compute[75051]:     </video>
Nov 24 19:16:52 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:16:52 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:16:52 user nova-compute[75051]:     </rng>
Nov 24 19:16:52 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:16:52 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:16:52 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:16:52 user nova-compute[75051]:     </memballoon>
Nov 24 19:16:52 user nova-compute[75051]:   </devices>
Nov 24 19:16:52 user nova-compute[75051]: </domain>
Nov 24 19:16:52 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-656798778',display_name='tempest-ServerRescueNegativeTestJSON-server-656798778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-656798778',id=37,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-wclbhxj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:51Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=c314a125-ae40-4829-af87-09288fd1d85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG os_vif [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '267c7932-1a7a-5cd5-af1d-b0b4922beeb5', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf1e8820-01, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf1e8820-01, col_values=(('qos', UUID('a4d53d92-e594-420a-8ef5-bc6ee98ab1c8')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf1e8820-01, col_values=(('external_ids', {'iface-id': 'cf1e8820-01b2-4c72-934e-ef5e5a52874b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:dc:c7', 'vm-uuid': 'c314a125-ae40-4829-af87-09288fd1d85a'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: INFO os_vif [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01')
Nov 24 19:16:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:13:dc:c7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updated VIF entry in instance network info cache for port cf1e8820-01b2-4c72-934e-ef5e5a52874b. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG nova.network.neutron [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:16:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5be6fa2f-cc96-4909-be4e-2c0035545e34 req-5adf9339-3b93-4df0-8c68-5a7d12767e6b service nova] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:53 user nova-compute[75051]: WARNING nova.compute.manager [req-01f949ff-a01e-435c-86ff-4b567d9166e6 req-e7ca6286-6f75-4419-934d-7735a8db67d3 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state building and task_state spawning.
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:55 user nova-compute[75051]: WARNING nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state building and task_state spawning.
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:55 user nova-compute[75051]: WARNING nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state building and task_state spawning.
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:16:55 user nova-compute[75051]: WARNING nova.compute.manager [req-f585edd1-afc0-49e9-ab3a-f875c0249a7b req-c7a9911a-82b7-4058-940d-79da74812754 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state building and task_state spawning.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance spawned successfully.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance spawned successfully.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.compute.manager [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Took 7.27 seconds to build instance.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7ccc26d-92b0-43e9-a121-82957144344d tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.397s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:16:56 user nova-compute[75051]: INFO nova.compute.manager [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Took 6.72 seconds to build instance.
Nov 24 19:16:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85e85c96-b8e1-4294-8eb5-a57155312d24 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:16:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:16:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:17:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=25.22296905517578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:17:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:31 user nova-compute[75051]: INFO nova.compute.manager [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Attaching volume 26113077-91ff-4639-ac7f-1928123732d4 to /dev/vdb
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.utils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dc28ca-6083-4900-ae20-547d21770f98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a195c5-5fff-43b1-8780-bf176211ac43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60723aae-5be7-4e3d-afe1-0f7a405924f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9aaca3-dd54-4606-a358-97d496b32797]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:17:31 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:17:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b1a56-aed6-4811-ad5f-fbc2d7bca792]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG os_brick.utils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:17:31 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating existing volume attachment record: 45ef0a81-603d-4223-8cf6-93695a850bc8 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:32 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:17:32 user nova-compute[75051]: INFO nova.compute.claims [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Claim successful on node user
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:17:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.policy [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '623c9f272b0e44f1a14364d1f90fc762', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c07aa581fa647a39092777af5ee366d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:17:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Creating image(s)
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "/opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "/opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk 1073741824" returned: 0 in 0.047s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:17:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Cannot resize image /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Ensure instance console log exists: /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Successfully created port: 97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Successfully updated port: 97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquired lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-changed-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Refreshing instance network info cache due to event network-changed-97a03c11-371d-47c0-96c6-8724efdce6a5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] Acquiring lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:35 user nova-compute[75051]: INFO nova.compute.manager [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Unshelving
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating instance_info_cache with network_info: [{"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Releasing lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Instance network_info: |[{"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] Acquired lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Refreshing network info cache for port 97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Start _get_guest_xml network_info=[{"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:17:35 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:35 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1306534104',display_name='tempest-AttachVolumeTestJSON-server-1306534104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1306534104',id=38,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF8QbWZkLhmWWY3RcALaBAMPnUJLG0ro0DreE/UB+3GjuFlmHqtm204T1jI5Y43lIjFaDXpat880xRJSfT1uvNSptfb15O72c8dEAUL6wxQW5ULyuvt8wMBA8H1m/Z1Q==',key_name='tempest-keypair-1676318082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-iedgeqx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=1fb902b2-7af2-41b9-af98-bede938c480e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:17:35 user nova-compute[75051]:   <uuid>1fb902b2-7af2-41b9-af98-bede938c480e</uuid>
Nov 24 19:17:35 user nova-compute[75051]:   <name>instance-00000026</name>
Nov 24 19:17:35 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:17:35 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:17:35 user nova-compute[75051]:   <metadata>
Nov 24 19:17:35 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:17:35 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeTestJSON-server-1306534104</nova:name>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:17:35</nova:creationTime>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:17:35 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:17:35 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:owner>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:user uuid="623c9f272b0e44f1a14364d1f90fc762">tempest-AttachVolumeTestJSON-866610194-project-member</nova:user>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:project uuid="2c07aa581fa647a39092777af5ee366d">tempest-AttachVolumeTestJSON-866610194</nova:project>
Nov 24 19:17:35 user nova-compute[75051]:       </nova:owner>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:17:35 user nova-compute[75051]:       <nova:ports>
Nov 24 19:17:35 user nova-compute[75051]:         <nova:port uuid="97a03c11-371d-47c0-96c6-8724efdce6a5">
Nov 24 19:17:35 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:17:35 user nova-compute[75051]:         </nova:port>
Nov 24 19:17:35 user nova-compute[75051]:       </nova:ports>
Nov 24 19:17:35 user nova-compute[75051]:     </nova:instance>
Nov 24 19:17:35 user nova-compute[75051]:   </metadata>
Nov 24 19:17:35 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:17:35 user nova-compute[75051]:     <system>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="serial">1fb902b2-7af2-41b9-af98-bede938c480e</entry>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="uuid">1fb902b2-7af2-41b9-af98-bede938c480e</entry>
Nov 24 19:17:35 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:17:35 user nova-compute[75051]:     </system>
Nov 24 19:17:35 user nova-compute[75051]:   </sysinfo>
Nov 24 19:17:35 user nova-compute[75051]:   <os>
Nov 24 19:17:35 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:17:35 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:17:35 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:17:35 user nova-compute[75051]:   </os>
Nov 24 19:17:35 user nova-compute[75051]:   <features>
Nov 24 19:17:35 user nova-compute[75051]:     <acpi/>
Nov 24 19:17:35 user nova-compute[75051]:     <apic/>
Nov 24 19:17:35 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:17:35 user nova-compute[75051]:   </features>
Nov 24 19:17:35 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:17:35 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:17:35 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:17:35 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:17:35 user nova-compute[75051]:   </clock>
Nov 24 19:17:35 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:17:35 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:17:35 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:17:35 user nova-compute[75051]:   </cpu>
Nov 24 19:17:35 user nova-compute[75051]:   <devices>
Nov 24 19:17:35 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:17:35 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:17:35 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk"/>
Nov 24 19:17:35 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:17:35 user nova-compute[75051]:     </disk>
Nov 24 19:17:35 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:17:35 user nova-compute[75051]:       <mac address="fa:16:3e:31:f3:0c"/>
Nov 24 19:17:35 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:17:35 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:17:35 user nova-compute[75051]:       <target dev="tap97a03c11-37"/>
Nov 24 19:17:35 user nova-compute[75051]:     </interface>
Nov 24 19:17:35 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:17:35 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/console.log" append="off"/>
Nov 24 19:17:35 user nova-compute[75051]:     </serial>
Nov 24 19:17:35 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:17:35 user nova-compute[75051]:     <video>
Nov 24 19:17:35 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:17:35 user nova-compute[75051]:     </video>
Nov 24 19:17:35 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:17:35 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:17:35 user nova-compute[75051]:     </rng>
Nov 24 19:17:35 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:17:35 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:17:35 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:17:35 user nova-compute[75051]:     </memballoon>
Nov 24 19:17:35 user nova-compute[75051]:   </devices>
Nov 24 19:17:35 user nova-compute[75051]: </domain>
Nov 24 19:17:35 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1306534104',display_name='tempest-AttachVolumeTestJSON-server-1306534104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1306534104',id=38,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF8QbWZkLhmWWY3RcALaBAMPnUJLG0ro0DreE/UB+3GjuFlmHqtm204T1jI5Y43lIjFaDXpat880xRJSfT1uvNSptfb15O72c8dEAUL6wxQW5ULyuvt8wMBA8H1m/Z1Q==',key_name='tempest-keypair-1676318082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-iedgeqx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:17:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=1fb902b2-7af2-41b9-af98-bede938c480e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_vif [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd29bcd8-ec35-558a-8f6d-4d2f149d3401', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97a03c11-37, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97a03c11-37, col_values=(('qos', UUID('d511288d-4d61-47f5-9c05-40d4f437308a')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97a03c11-37, col_values=(('external_ids', {'iface-id': '97a03c11-371d-47c0-96c6-8724efdce6a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f3:0c', 'vm-uuid': '1fb902b2-7af2-41b9-af98-bede938c480e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:35 user nova-compute[75051]: INFO os_vif [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37')
Nov 24 19:17:35 user nova-compute[75051]: INFO nova.virt.block_device [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Booting with volume 9e182143-d8c4-4476-afeb-e4d1edfef35c at /dev/vdc
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No VIF found with MAC fa:16:3e:31:f3:0c, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.utils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bf91db-ebc3-464d-b7d1-ce093a5fc796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e35ce5-d72c-4acb-ba2a-84a1ea6192d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fad45f3-ca02-4f20-bcd5-f3ef7142bde2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103a1c8-5e19-4a94-ac08-7c846f444467]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:17:35 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea95219-e044-42fb-86af-e235669cd5c2]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG os_brick.utils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating existing volume attachment record: 6c21cd1d-7885-4c06-851a-5ec9a46b0f6f {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updated VIF entry in instance network info cache for port 97a03c11-371d-47c0-96c6-8724efdce6a5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG nova.network.neutron [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating instance_info_cache with network_info: [{"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-55ee4a53-bdb2-4a2f-b259-76f94f5f6d1d req-f584b00b-03ba-45a5-9455-9270850a6330 service nova] Releasing lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:17:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] No waiting events found dispatching network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:37 user nova-compute[75051]: WARNING nova.compute.manager [req-f8b3fb9f-fc82-4a20-9dc0-0f656712422b req-fbbf78d7-fccf-48fa-8e7e-3aa3ebc99abe service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received unexpected event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 for instance with vm_state building and task_state spawning.
Nov 24 19:17:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOCZKQhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:17:37 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:17:37 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:17:37 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c87452-ff00-487f-a720-34eb94ae2c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:17:37 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8ae5be-61c0-48a5-9333-0be35bacb9cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4] added
Nov 24 19:17:37 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd10219-44ae-4ed6-8307-b5fed6c35cad]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b600a17e-aa16-4677-96d2-a47d261beae2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOCZKQhN {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IOCZKQhN" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9e48fe-9db7-4f22-9d0b-44019fad253f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IOCZKQhN'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d440117-c6e9-44fe-91dd-d78e5b5db47c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[51467ada-0582-4812-a13c-4edb240c1657]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:17:37 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:17:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:17:37 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:17:37 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:17:37 user nova-compute[75051]: 
Nov 24 19:17:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9545821-7ae0-4547-ad50-6a1161b15c24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260]
Nov 24 19:17:38 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260] successful.
Nov 24 19:17:38 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bd7f5-ead2-430d-83a8-70117f2fe064]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[394226cb-9b11-49d6-816a-e6f086bf173c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:38 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:38 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae3aa79-ba9b-428a-9632-2765ad355ba4]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:38 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOCZKQhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23064313061366235', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064313061366235', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:17:39 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:17:39 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:17:39 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:17:39 user nova-compute[75051]:   <serial>26113077-91ff-4639-ac7f-1928123732d4</serial>
Nov 24 19:17:39 user nova-compute[75051]: </disk>
Nov 24 19:17:39 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] No waiting events found dispatching network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:39 user nova-compute[75051]: WARNING nova.compute.manager [req-26f5b08f-dd65-4e96-b4a7-9f9088567d14 req-83a38be8-1b68-4928-a71f-6ced5e65fd35 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received unexpected event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 for instance with vm_state building and task_state spawning.
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:17:39 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Instance spawned successfully.
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:17:39 user nova-compute[75051]: INFO nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:17:39 user nova-compute[75051]: INFO nova.compute.manager [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Took 6.59 seconds to build instance.
Nov 24 19:17:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-76d381ad-6b4b-44be-a5d0-2e4d75459f61 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] No VIF found with MAC fa:16:3e:38:ce:7b, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:17:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0515e02b-903c-41c5-b510-2c88a663b303 tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.052s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing instance network info cache due to event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.network.neutron [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_requests' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'numa_topology' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:17:42 user nova-compute[75051]: INFO nova.compute.claims [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Claim successful on node user
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.network.neutron [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated VIF entry in instance network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG nova.network.neutron [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:42 user nova-compute[75051]: INFO nova.network.neutron [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 19:17:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-168f31a7-6fdd-4206-9eb6-c7f9ce6305f4 req-3981ead0-6b70-4cc5-8f58-d6a8d66133ef service nova] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing instance network info cache due to event network-changed-7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] Acquiring lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:17:43 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Creating image(s)
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'trusted_certs' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] Acquired lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Refreshing network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG nova.objects.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<93812981-7340-4edb-9687-008c40475bf9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing instance network info cache due to event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.virt.images [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] 8bb2db0f-e128-458e-84c4-c6a8cacff307 was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.part /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.007s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:45 user nova-compute[75051]: INFO nova.compute.manager [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Rebooting instance
Nov 24 19:17:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updated VIF entry in instance network info cache for port 7ff3f80c-a6c8-41d9-89e3-9f6121a76640. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated VIF entry in instance network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b470acb-dee7-418a-ae1f-8e3fed17d6e9 req-36879c64-03b3-491d-b9ea-d25148d92079 service nova] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-aedc961f-9c25-4a40-ab18-3732aa7e0a0b req-2eeb789b-8149-4868-a852-e355111cfe64 service nova] Releasing lock "refresh_cache-93812981-7340-4edb-9687-008c40475bf9" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:17:45 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.part /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.converted" returned: 0 in 0.877s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.544s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json" returned: 0 in 0.243s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016,backing_fmt=raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016,backing_fmt=raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk 1073741824" returned: 0 in 0.131s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "ad15fdf451a7a1525a1fd1a2395e7b6106ac6016" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.381s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'migration_context' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG nova.objects.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<93812981-7340-4edb-9687-008c40475bf9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:17:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Rebasing disk image.
Nov 24 19:17:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 -F raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:49 user nova-compute[75051]: WARNING nova.compute.manager [req-94d225eb-4fd4-496b-b4fb-fb6b6baff084 req-e18ec327-004c-4120-8004-1d56bb30e507 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state active and task_state reboot_started.
Nov 24 19:17:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 -F raw /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk" returned: 0 in 2.848s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Ensure instance console log exists: /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start _get_guest_xml network_info=[{"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='62e9b08604a1f7533e431eee3e495f89',container_format='bare',created_at=2023-11-24T19:15:43Z,direct_url=<?>,disk_format='qcow2',id=8bb2db0f-e128-458e-84c4-c6a8cacff307,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1452222332-shelved',owner='6cc3182a5d4540cfab6a2a919f79f3b9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T19:15:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqbtPgnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '93812981-7340-4edb-9687-008c40475bf9', 'attached_at': '', 'detached_at': '', 'volume_id': '9e182143-d8c4-4476-afeb-e4d1edfef35c', 'serial': '9e182143-d8c4-4476-afeb-e4d1edfef35c'}, 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '6c21cd1d-7885-4c06-851a-5ec9a46b0f6f', 'boot_index': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='62e9b08604a1f7533e431eee3e495f89',container_format='bare',created_at=2023-11-24T19:15:43Z,direct_url=<?>,disk_format='qcow2',id=8bb2db0f-e128-458e-84c4-c6a8cacff307,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1452222332-shelved',owner='6cc3182a5d4540cfab6a2a919f79f3b9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T19:15:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'vcpu_model' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance shutdown successfully.
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.objects.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<93812981-7340-4edb-9687-008c40475bf9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqbtPgnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:17:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:17:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:17:50 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[604a72c6-f4c3-4389-ad68-da56bad07f4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:17:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390637a-8702-4790-88e7-d0c9166f0886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c] added
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[120ade7b-9693-479e-a2c4-a64f2ea43dde]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c7bba-3f26-451f-b34d-875ac850b7fd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqbtPgnF {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JqbtPgnF" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a156d-71cf-40a5-ad6e-6a711984a13e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JqbtPgnF'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc0015a-b7d0-49ce-9033-587d2504c9be]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aee072-3a2f-4f2b-9417-66eb0f38421d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86185354-c4a4-4d68-b284-8c78c30b08fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260]
Nov 24 19:17:50 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260] successful.
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d852a-96e9-4d13-be74-d4dc077afb62]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb67c70-5703-4793-9ad9-bb051bbf27fa]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:50 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:17:50 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:17:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9379c20-1351-4028-85ff-c5d1713ef8be]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:17:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqbtPgnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:51 user nova-compute[75051]: WARNING nova.compute.manager [req-7cbe9318-966b-4cf9-916d-edcd3f3b48c9 req-13b55ad6-06cb-4631-9b48-66963115d529 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state active and task_state reboot_started.
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23635333233616163', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635333233616163', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='8bb2db0f-e128-458e-84c4-c6a8cacff307',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-362163077',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:15:47.719060',shelved_host='user',shelved_image_id='8bb2db0f-e128-458e-84c4-c6a8cacff307'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_devices' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.objects.base [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<93812981-7340-4edb-9687-008c40475bf9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:17:51 user nova-compute[75051]:   <uuid>93812981-7340-4edb-9687-008c40475bf9</uuid>
Nov 24 19:17:51 user nova-compute[75051]:   <name>instance-00000022</name>
Nov 24 19:17:51 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:17:51 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:17:51 user nova-compute[75051]:   <metadata>
Nov 24 19:17:51 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:17:51 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1452222332</nova:name>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:17:50</nova:creationTime>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:17:51 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:17:51 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:owner>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:user uuid="b2c20e8819f346e8b5c57a77becb0c68">tempest-AttachVolumeShelveTestJSON-1174395931-project-member</nova:user>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:project uuid="6cc3182a5d4540cfab6a2a919f79f3b9">tempest-AttachVolumeShelveTestJSON-1174395931</nova:project>
Nov 24 19:17:51 user nova-compute[75051]:       </nova:owner>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:root type="image" uuid="8bb2db0f-e128-458e-84c4-c6a8cacff307"/>
Nov 24 19:17:51 user nova-compute[75051]:       <nova:ports>
Nov 24 19:17:51 user nova-compute[75051]:         <nova:port uuid="7ff3f80c-a6c8-41d9-89e3-9f6121a76640">
Nov 24 19:17:51 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:17:51 user nova-compute[75051]:         </nova:port>
Nov 24 19:17:51 user nova-compute[75051]:       </nova:ports>
Nov 24 19:17:51 user nova-compute[75051]:     </nova:instance>
Nov 24 19:17:51 user nova-compute[75051]:   </metadata>
Nov 24 19:17:51 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:17:51 user nova-compute[75051]:     <system>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="serial">93812981-7340-4edb-9687-008c40475bf9</entry>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="uuid">93812981-7340-4edb-9687-008c40475bf9</entry>
Nov 24 19:17:51 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:17:51 user nova-compute[75051]:     </system>
Nov 24 19:17:51 user nova-compute[75051]:   </sysinfo>
Nov 24 19:17:51 user nova-compute[75051]:   <os>
Nov 24 19:17:51 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:17:51 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:17:51 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:17:51 user nova-compute[75051]:   </os>
Nov 24 19:17:51 user nova-compute[75051]:   <features>
Nov 24 19:17:51 user nova-compute[75051]:     <acpi/>
Nov 24 19:17:51 user nova-compute[75051]:     <apic/>
Nov 24 19:17:51 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:17:51 user nova-compute[75051]:   </features>
Nov 24 19:17:51 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:17:51 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:17:51 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:17:51 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:17:51 user nova-compute[75051]:   </clock>
Nov 24 19:17:51 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:17:51 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:17:51 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:17:51 user nova-compute[75051]:   </cpu>
Nov 24 19:17:51 user nova-compute[75051]:   <devices>
Nov 24 19:17:51 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:17:51 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:17:51 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk"/>
Nov 24 19:17:51 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:17:51 user nova-compute[75051]:     </disk>
Nov 24 19:17:51 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:17:51 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:17:51 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:17:51 user nova-compute[75051]:       <target dev="vdc" bus="virtio"/>
Nov 24 19:17:51 user nova-compute[75051]:       <serial>9e182143-d8c4-4476-afeb-e4d1edfef35c</serial>
Nov 24 19:17:51 user nova-compute[75051]:     </disk>
Nov 24 19:17:51 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:17:51 user nova-compute[75051]:       <mac address="fa:16:3e:e1:2d:57"/>
Nov 24 19:17:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:17:51 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:17:51 user nova-compute[75051]:       <target dev="tap7ff3f80c-a6"/>
Nov 24 19:17:51 user nova-compute[75051]:     </interface>
Nov 24 19:17:51 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:17:51 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/console.log" append="off"/>
Nov 24 19:17:51 user nova-compute[75051]:     </serial>
Nov 24 19:17:51 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:17:51 user nova-compute[75051]:     <video>
Nov 24 19:17:51 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:17:51 user nova-compute[75051]:     </video>
Nov 24 19:17:51 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:17:51 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:17:51 user nova-compute[75051]:     </rng>
Nov 24 19:17:51 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:17:51 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:17:51 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:17:51 user nova-compute[75051]:     </memballoon>
Nov 24 19:17:51 user nova-compute[75051]:   </devices>
Nov 24 19:17:51 user nova-compute[75051]: </domain>
Nov 24 19:17:51 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='8bb2db0f-e128-458e-84c4-c6a8cacff307',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-362163077',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:13:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:15:47.719060',shelved_host='user',shelved_image_id='8bb2db0f-e128-458e-84c4-c6a8cacff307'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG os_vif [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94cbac94-f8c4-572e-9255-8bcb647c555b', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff3f80c-a6, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ff3f80c-a6, col_values=(('qos', UUID('32cf7f03-d5ab-4c1f-982d-fcfcfce896bb')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ff3f80c-a6, col_values=(('external_ids', {'iface-id': '7ff3f80c-a6c8-41d9-89e3-9f6121a76640', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:2d:57', 'vm-uuid': '93812981-7340-4edb-9687-008c40475bf9'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:51 user nova-compute[75051]: INFO os_vif [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6')
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:17:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No VIF found with MAC fa:16:3e:e1:2d:57, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state active and task_state reboot_started.
Nov 24 19:17:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:53 user nova-compute[75051]: WARNING nova.compute.manager [req-7fe1c14b-a6df-4b91-9c73-3cd0cd315047 req-f2bd4e68-7f3f-4121-aa58-8b388797c0f5 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state active and task_state reboot_started.
Nov 24 19:17:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance running successfully.
Nov 24 19:17:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance soft rebooted successfully.
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5de71607-7679-48ef-9689-ab677c29a54c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.746s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:17:55 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance spawned successfully.
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:55 user nova-compute[75051]: WARNING nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:17:55 user nova-compute[75051]: WARNING nova.compute.manager [req-eaf820df-d3aa-4901-8e1c-6477b6178cc0 req-54cb6802-d613-4828-91f8-3eaca58407b1 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 19:17:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:17:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-8bc37f79-18df-4da9-a4df-a215586277a7 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.527s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:17:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:17:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:22 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:18:25 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:18:25 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=25.157745361328125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1fb902b2-7af2-41b9-af98-bede938c480e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 93812981-7340-4edb-9687-008c40475bf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:18:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:18:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:18:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:18:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:18:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:18:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:40 user nova-compute[75051]: INFO nova.compute.manager [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Rescuing
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:18:40 user nova-compute[75051]: WARNING nova.compute.manager [req-4a25f91d-ccd0-4ca8-9123-60f5634993af req-a0c34034-5ff2-424b-a4a0-0ffa93e9971b service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state active and task_state rescuing.
Nov 24 19:18:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance destroyed successfully.
Nov 24 19:18:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Attempting rescue
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 19:18:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Creating image(s)
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'trusted_certs' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue" returned: 0 in 0.057s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'migration_context' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.base [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<c314a125-ae40-4829-af87-09288fd1d85a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start _get_guest_xml network_info=[{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:13:dc:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.base [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<c314a125-ae40-4829-af87-09288fd1d85a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'numa_topology' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.base [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<c314a125-ae40-4829-af87-09288fd1d85a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:18:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:18:41 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'vcpu_model' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.base [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<c314a125-ae40-4829-af87-09288fd1d85a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-656798778',display_name='tempest-ServerRescueNegativeTestJSON-server-656798778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-656798778',id=37,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-wclbhxj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:57Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=c314a125-ae40-4829-af87-09288fd1d85a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:13:dc:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:13:dc:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.objects.base [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<c314a125-ae40-4829-af87-09288fd1d85a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:18:41 user nova-compute[75051]:   <uuid>c314a125-ae40-4829-af87-09288fd1d85a</uuid>
Nov 24 19:18:41 user nova-compute[75051]:   <name>instance-00000025</name>
Nov 24 19:18:41 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:18:41 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:18:41 user nova-compute[75051]:   <metadata>
Nov 24 19:18:41 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:18:41 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-656798778</nova:name>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:18:41</nova:creationTime>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:18:41 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:18:41 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:owner>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:18:41 user nova-compute[75051]:       </nova:owner>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:18:41 user nova-compute[75051]:       <nova:ports>
Nov 24 19:18:41 user nova-compute[75051]:         <nova:port uuid="cf1e8820-01b2-4c72-934e-ef5e5a52874b">
Nov 24 19:18:41 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 19:18:41 user nova-compute[75051]:         </nova:port>
Nov 24 19:18:41 user nova-compute[75051]:       </nova:ports>
Nov 24 19:18:41 user nova-compute[75051]:     </nova:instance>
Nov 24 19:18:41 user nova-compute[75051]:   </metadata>
Nov 24 19:18:41 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:18:41 user nova-compute[75051]:     <system>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="serial">c314a125-ae40-4829-af87-09288fd1d85a</entry>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="uuid">c314a125-ae40-4829-af87-09288fd1d85a</entry>
Nov 24 19:18:41 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:18:41 user nova-compute[75051]:     </system>
Nov 24 19:18:41 user nova-compute[75051]:   </sysinfo>
Nov 24 19:18:41 user nova-compute[75051]:   <os>
Nov 24 19:18:41 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:18:41 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:18:41 user nova-compute[75051]:   </os>
Nov 24 19:18:41 user nova-compute[75051]:   <features>
Nov 24 19:18:41 user nova-compute[75051]:     <acpi/>
Nov 24 19:18:41 user nova-compute[75051]:     <apic/>
Nov 24 19:18:41 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:18:41 user nova-compute[75051]:   </features>
Nov 24 19:18:41 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:18:41 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:18:41 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:18:41 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:18:41 user nova-compute[75051]:   </clock>
Nov 24 19:18:41 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:18:41 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:18:41 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:18:41 user nova-compute[75051]:   </cpu>
Nov 24 19:18:41 user nova-compute[75051]:   <devices>
Nov 24 19:18:41 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:18:41 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:18:41 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue"/>
Nov 24 19:18:41 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:18:41 user nova-compute[75051]:     </disk>
Nov 24 19:18:41 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:18:41 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:18:41 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk"/>
Nov 24 19:18:41 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:18:41 user nova-compute[75051]:     </disk>
Nov 24 19:18:41 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:18:41 user nova-compute[75051]:       <mac address="fa:16:3e:13:dc:c7"/>
Nov 24 19:18:41 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:18:41 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:18:41 user nova-compute[75051]:       <target dev="tapcf1e8820-01"/>
Nov 24 19:18:41 user nova-compute[75051]:     </interface>
Nov 24 19:18:41 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:18:41 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/console.log" append="off"/>
Nov 24 19:18:41 user nova-compute[75051]:     </serial>
Nov 24 19:18:41 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:18:41 user nova-compute[75051]:     <video>
Nov 24 19:18:41 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:18:41 user nova-compute[75051]:     </video>
Nov 24 19:18:41 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:18:41 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:18:41 user nova-compute[75051]:     </rng>
Nov 24 19:18:41 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:18:41 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:18:41 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:18:41 user nova-compute[75051]:     </memballoon>
Nov 24 19:18:41 user nova-compute[75051]:   </devices>
Nov 24 19:18:41 user nova-compute[75051]: </domain>
Nov 24 19:18:41 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:18:41 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance destroyed successfully.
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:13:dc:c7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:18:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:18:42 user nova-compute[75051]: WARNING nova.compute.manager [req-e00c8fd6-523f-458a-8761-5c306f3d1df1 req-72ec5839-f0fe-4a0e-8e96-13ad52cfa45f service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state active and task_state rescuing.
Nov 24 19:18:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:18:45 user nova-compute[75051]: WARNING nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state active and task_state rescuing.
Nov 24 19:18:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:18:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:18:45 user nova-compute[75051]: WARNING nova.compute.manager [req-19e34b4b-f770-4751-862d-226c24212821 req-99979cf6-b359-4588-969b-6d34ef921d2d service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state active and task_state rescuing.
Nov 24 19:18:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-905ec5e2-b038-4bb4-a818-2213b00a74e8 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:18:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:18:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:19:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "c314a125-ae40-4829-af87-09288fd1d85a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "c314a125-ae40-4829-af87-09288fd1d85a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:23 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-changed-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Refreshing instance network info cache due to event network-changed-97a03c11-371d-47c0-96c6-8724efdce6a5. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] Acquiring lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] Acquired lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Refreshing network info cache for port 97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updated VIF entry in instance network info cache for port 97a03c11-371d-47c0-96c6-8724efdce6a5. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating instance_info_cache with network_info: [{"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c6421cdf-c915-4e22-9b62-5e8350679742 req-317cfd7f-26d8-4d4b-8dea-9ee732f39eae service nova] Releasing lock "refresh_cache-1fb902b2-7af2-41b9-af98-bede938c480e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:19:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:26 user nova-compute[75051]: INFO nova.compute.manager [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Detaching volume 9e182143-d8c4-4476-afeb-e4d1edfef35c
Nov 24 19:19:26 user nova-compute[75051]: INFO nova.virt.block_device [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Attempting to driver detach volume 9e182143-d8c4-4476-afeb-e4d1edfef35c from mountpoint /dev/vdc
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Attempting to detach device vdc from instance 93812981-7340-4edb-9687-008c40475bf9 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:26 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:26 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:19:26 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:19:26 user nova-compute[75051]:   <serial>9e182143-d8c4-4476-afeb-e4d1edfef35c</serial>
Nov 24 19:19:26 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:19:26 user nova-compute[75051]: </disk>
Nov 24 19:19:26 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:19:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully detached device vdc from instance 93812981-7340-4edb-9687-008c40475bf9 from the persistent domain config.
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 93812981-7340-4edb-9687-008c40475bf9 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:26 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:26 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:19:26 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:19:26 user nova-compute[75051]:   <serial>9e182143-d8c4-4476-afeb-e4d1edfef35c</serial>
Nov 24 19:19:26 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 24 19:19:26 user nova-compute[75051]: </disk>
Nov 24 19:19:26 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:19:26 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:19:26 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=25.156047821044922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.objects.instance [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1fb902b2-7af2-41b9-af98-bede938c480e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 93812981-7340-4edb-9687-008c40475bf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:19:26 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:27 user nova-compute[75051]: INFO nova.compute.manager [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attaching volume 1bbbfc1d-3260-4f81-b3f4-da23ff5f304b to /dev/vdb
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.utils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c9ac4d-4e69-49b3-90b5-865ec927ae49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5702061f-779b-4341-b73a-5c3a09eba9fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf18da60-d1dd-4139-8b01-4fe6bc44f242]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbebc8fd-3075-4719-89db-434d6120f854]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:19:27 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8eba6-330d-4c1c-a0db-d57a0d246bb0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG os_brick.utils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating existing volume attachment record: 6fb5e083-9b6e-4da7-9c53-602389190270 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:19:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:30 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:19:31 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:19:32 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:19:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:19:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:19:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foUcHMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:33 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:33 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:33 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c99907-7ec2-4675-a649-2badf81c4428]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:19:33 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd83f2-84ac-42bb-bc33-48b151dd95f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b] added
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0da08a-f943-4b69-aef7-f4fc63e06ea7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b42cc9-93c1-456a-bf39-d6835f251602]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foUcHMRL {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v foUcHMRL" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[804bc384-d3bf-4f55-854d-9c500f303b9c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'foUcHMRL'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6d1728-c0b9-4069-85cb-18acbf09710e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[360da6e4-1e3c-485f-83f3-8408e543b5b5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3784c00e-6d05-445e-8193-a5a1cefee6fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260]
Nov 24 19:19:33 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260] successful.
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6b074-01e3-4dce-9f62-1f77801c65a7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777e75f-28e2-46af-add1-b0e20af16de9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:33 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c838e-b581-4259-ab9e-d323b0f86fed]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:19:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foUcHMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23061303734353333', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061303734353333', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.objects.instance [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:19:34 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:34 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:19:34 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:19:34 user nova-compute[75051]:   <serial>1bbbfc1d-3260-4f81-b3f4-da23ff5f304b</serial>
Nov 24 19:19:34 user nova-compute[75051]: </disk>
Nov 24 19:19:34 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:19:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No VIF found with MAC fa:16:3e:31:f3:0c, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:19:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-fdc525fb-dc02-48cd-8bd2-3258039d6581 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.069s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing instance network info cache due to event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG nova.network.neutron [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated VIF entry in instance network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e488d979-d600-4b51-934f-5fc8f516f54a req-7eb506aa-cd1a-4ea9-b09f-d919a579b3c9 service nova] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.objects.instance [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:38 user nova-compute[75051]: INFO nova.compute.manager [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attaching volume 625b5253-8be6-4f28-bc73-209b1c84ea48 to /dev/vdc
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.utils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[872eba63-6486-4b3e-9f42-8be9b98da6b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[49874668-72d5-4dcf-88db-bb7a62f79a5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf02ee89-7dff-40e4-885d-4b332addd79c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a24da53-78ed-4c01-971f-946c9b80b15a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing instance network info cache due to event network-changed-b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] Acquiring lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] Acquired lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Refreshing network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:19:38 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70494f-a306-440e-b187-1f397bb6a0aa]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG os_brick.utils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating existing volume attachment record: 26be3824-0cd4-4085-b783-e7e87ade6c02 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:38 user nova-compute[75051]: INFO nova.compute.manager [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Detaching volume 26113077-91ff-4639-ac7f-1928123732d4
Nov 24 19:19:38 user nova-compute[75051]: INFO nova.virt.block_device [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Attempting to driver detach volume 26113077-91ff-4639-ac7f-1928123732d4 from mountpoint /dev/vdb
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Attempting to detach device vdb from instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:38 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:38 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:19:38 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:19:38 user nova-compute[75051]:   <serial>26113077-91ff-4639-ac7f-1928123732d4</serial>
Nov 24 19:19:38 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:19:38 user nova-compute[75051]: </disk>
Nov 24 19:19:38 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully detached device vdb from instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa from the persistent domain config.
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:19:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:38 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:38 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:19:38 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:19:38 user nova-compute[75051]:   <serial>26113077-91ff-4639-ac7f-1928123732d4</serial>
Nov 24 19:19:38 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:19:38 user nova-compute[75051]: </disk>
Nov 24 19:19:38 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updated VIF entry in instance network info cache for port b7b40a71-9e06-4179-9167-c86bdcbf8518. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:19:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [{"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:19:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d904f050-9e79-4ea1-a2da-09e597bdbd0c req-47e54e43-920c-40cb-9f1b-660875e04479 service nova] Releasing lock "refresh_cache-430f20f2-3d8d-452b-a410-c4f05e32d7aa" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:19:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:19:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:19:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pidJfzLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:44 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c8e4cc-f7e1-45c8-986f-3a688a3e330e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:19:44 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193e7e2-ad1f-4554-a4dd-4df42adcbd23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48] added
Nov 24 19:19:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d1814-5e3a-465b-9a9f-9c5ae4445956]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31d316f-413f-4728-a096-68a340b9189a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pidJfzLr {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pidJfzLr" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[592e8571-610c-4eda-89cc-8e8a14172a1b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pidJfzLr'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dfd032-6e93-4c80-9634-3340e2301153]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d810ff8-b9bd-4f2c-be7f-a6856e62b75d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f4e26-f3bf-4e27-b751-572e3ed4ccdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260]
Nov 24 19:19:45 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260] successful.
Nov 24 19:19:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce16674a-8a67-4950-926f-7da866b240fb]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff61bb-b95e-489a-8f1c-24d23e53d13a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:45 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:45 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3418beb9-2614-4bf4-a67a-745fe3a0f72a]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:19:45 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pidJfzLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23666386266326130', 'path': '/dev/sde'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666386266326130', 'path': '/dev/sde'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:19:46 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:46 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 19:19:46 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:19:46 user nova-compute[75051]:   <serial>625b5253-8be6-4f28-bc73-209b1c84ea48</serial>
Nov 24 19:19:46 user nova-compute[75051]: </disk>
Nov 24 19:19:46 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] No VIF found with MAC fa:16:3e:31:f3:0c, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:19:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 93812981-7340-4edb-9687-008c40475bf9 is timed out.
Nov 24 19:19:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully detached device vdc from instance 93812981-7340-4edb-9687-008c40475bf9 from the live domain config.
Nov 24 19:19:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JqbtPgnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:46 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-df7817f1-e916-4800-85c5-c0ad90b9f0d6 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.241s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c34efb4-e683-4949-a123-ae384f6f4593]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:19:46 user nova-compute[75051]: No targets found.
Nov 24 19:19:46 user nova-compute[75051]: iSNS:
Nov 24 19:19:46 user nova-compute[75051]: No targets found.
Nov 24 19:19:46 user nova-compute[75051]: STATIC:
Nov 24 19:19:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b
Nov 24 19:19:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4
Nov 24 19:19:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48
Nov 24 19:19:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c
Nov 24 19:19:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:46 user nova-compute[75051]: FIRMWARE:
Nov 24 19:19:46 user nova-compute[75051]: No targets found.
Nov 24 19:19:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:19:46 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:19:46 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f08ab97-84f8-4ac3-a0db-a4b46f1934a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d049a-1a37-49b2-a446-26eabd069226]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:46 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0226560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa15ac1-e054-4572-8cf8-df2b3d2f5804]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef814a-6726-4fc8-9596-84d5e4492f0c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61b5720-b941-472e-b21a-0348561431a9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cea501-6c0f-4b07-b0c9-7fe0bbee518e]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:19:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8235225f-e07e-4ea4-960e-d70192575a63]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb70e3a-060d-4799-b1bf-38319de2911b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260]
Nov 24 19:19:47 user nova-compute[75051]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c, portal: 172.16.0.220,3260] successful.
Nov 24 19:19:47 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e182143-d8c4-4476-afeb-e4d1edfef35c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7ed56-b335-473a-b57a-ddcfd73833d4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] <== disconnect_volume: return (324ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:19:47 user nova-compute[75051]: INFO nova.compute.manager [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Detaching volume 1bbbfc1d-3260-4f81-b3f4-da23ff5f304b
Nov 24 19:19:47 user nova-compute[75051]: INFO nova.virt.block_device [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attempting to driver detach volume 1bbbfc1d-3260-4f81-b3f4-da23ff5f304b from mountpoint /dev/vdb
Nov 24 19:19:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Attempting to detach device vdb from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:47 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:19:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:19:47 user nova-compute[75051]:   <serial>1bbbfc1d-3260-4f81-b3f4-da23ff5f304b</serial>
Nov 24 19:19:47 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:19:47 user nova-compute[75051]: </disk>
Nov 24 19:19:47 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:47 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdb from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the persistent domain config.
Nov 24 19:19:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:19:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:19:47 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:19:47 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:19:47 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:19:47 user nova-compute[75051]:   <serial>1bbbfc1d-3260-4f81-b3f4-da23ff5f304b</serial>
Nov 24 19:19:47 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:19:47 user nova-compute[75051]: </disk>
Nov 24 19:19:47 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:19:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'flavor' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:19:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00b07b06-8331-49af-baf8-8275c6087df4 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:19:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:19:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:19:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:19:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa is timed out.
Nov 24 19:19:59 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully detached device vdb from instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa from the live domain config.
Nov 24 19:19:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IOCZKQhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:19:59 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5bf0bf-9c7a-4469-9133-148d5856f1eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:19:59 user nova-compute[75051]: No targets found.
Nov 24 19:19:59 user nova-compute[75051]: iSNS:
Nov 24 19:19:59 user nova-compute[75051]: No targets found.
Nov 24 19:19:59 user nova-compute[75051]: STATIC:
Nov 24 19:19:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b
Nov 24 19:19:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4
Nov 24 19:19:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48
Nov 24 19:19:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:19:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:19:59 user nova-compute[75051]: FIRMWARE:
Nov 24 19:19:59 user nova-compute[75051]: No targets found.
Nov 24 19:19:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:19:59 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:19:59 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9d5c16-cea0-4f8d-a88c-88249c4968f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1290347-5509-48e9-b00a-c957aed07901]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:59 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:59 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 (non-flash)
Nov 24 19:19:59 user nova-compute[75051]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:19:59 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:19:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05a4430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb6aafb-ae84-46f7-a387-07d6e4ab1ae3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197d6db-31f3-4fe3-9bc3-6509a347cb29]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f6e1b-ae70-45a6-b4bc-e589fd1dabd5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fefe8f-be25-48b3-8283-5576feb90ab7]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25330dc-1d3e-486f-878c-2bf1056e686e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0810a-67f6-4827-aecc-a1212ed655b8]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260]
Nov 24 19:19:59 user nova-compute[75051]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4, portal: 172.16.0.220,3260] successful.
Nov 24 19:19:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26113077-91ff-4639-ac7f-1928123732d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238387d-b996-41b4-96ab-179732cc7af6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] <== disconnect_volume: return (305ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:19:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:20:00 user nova-compute[75051]: DEBUG nova.objects.instance [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'flavor' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-88890f3c-fa49-4c0e-bea4-829a7d70f30e tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.903s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:08 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1fb902b2-7af2-41b9-af98-bede938c480e is timed out.
Nov 24 19:20:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdb from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the live domain config.
Nov 24 19:20:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'foUcHMRL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:20:08 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e99a769-2d12-46ee-acf6-ff4f69133715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:20:08 user nova-compute[75051]: No targets found.
Nov 24 19:20:08 user nova-compute[75051]: iSNS:
Nov 24 19:20:08 user nova-compute[75051]: No targets found.
Nov 24 19:20:08 user nova-compute[75051]: STATIC:
Nov 24 19:20:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b
Nov 24 19:20:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:20:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:20:08 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48
Nov 24 19:20:08 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:20:08 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:20:08 user nova-compute[75051]: FIRMWARE:
Nov 24 19:20:08 user nova-compute[75051]: No targets found.
Nov 24 19:20:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:20:08 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:20:08 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d9f432-f0c2-42b0-bca4-0585b80468e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8854d966-003c-40af-a032-a74fb26c2d85]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:20:08 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:20:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b (non-flash)
Nov 24 19:20:08 user nova-compute[75051]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:20:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c05069e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb577f-088c-416f-9379-83868c9a101b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6679c3d-46e2-404d-9b0f-267f28992353]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f7d311-163e-4b22-b079-2d3c2a2b2cd6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1b7e2-0396-474c-b34a-1eb0648797a4]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[529177ca-09f2-4acc-ace3-547153133c8c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a85a29-0bc6-4512-9246-3536458167af]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260]
Nov 24 19:20:08 user nova-compute[75051]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b, portal: 172.16.0.220,3260] successful.
Nov 24 19:20:08 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1bbbfc1d-3260-4f81-b3f4-da23ff5f304b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f92fc-44ba-4467-8a2e-062974b9d9d7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== disconnect_volume: return (307ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:20:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:20:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1f11a653-e1ac-47a3-aa5d-186e57983c88 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.622s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:10 user nova-compute[75051]: INFO nova.compute.manager [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Detaching volume 625b5253-8be6-4f28-bc73-209b1c84ea48
Nov 24 19:20:10 user nova-compute[75051]: INFO nova.virt.block_device [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Attempting to driver detach volume 625b5253-8be6-4f28-bc73-209b1c84ea48 from mountpoint /dev/vdc
Nov 24 19:20:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Attempting to detach device vdc from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:20:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:20:10 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:20:10 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 19:20:10 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:20:10 user nova-compute[75051]:   <serial>625b5253-8be6-4f28-bc73-209b1c84ea48</serial>
Nov 24 19:20:10 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 19:20:10 user nova-compute[75051]: </disk>
Nov 24 19:20:10 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:20:10 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdc from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the persistent domain config.
Nov 24 19:20:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:20:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:20:10 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:20:10 user nova-compute[75051]:   <source dev="/dev/sde"/>
Nov 24 19:20:10 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:20:10 user nova-compute[75051]:   <serial>625b5253-8be6-4f28-bc73-209b1c84ea48</serial>
Nov 24 19:20:10 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 19:20:10 user nova-compute[75051]: </disk>
Nov 24 19:20:10 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:20:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:20:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:16 user nova-compute[75051]: INFO nova.compute.manager [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Terminating instance
Nov 24 19:20:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-e24317f2-dfb6-4434-a1d7-d7ebc00c40ba req-635d275f-1561-484a-82df-30b79f46e628 service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-unplugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:20:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Instance destroyed successfully.
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.objects.instance [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'resources' on Instance uuid 93812981-7340-4edb-9687-008c40475bf9 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:13:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452222332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452222332',id=34,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6OZv3jXGf9epEXTqvTWh5SlTGZYuKu1FF6p84uy4zPjNDLiSBKdS5r9Our+gDCpFZls95eThzT9NIZNIyU5wQe163AbQfRGBKOk3p8cIG5pfkPPikDcui/JPqG5/LJDg==',key_name='tempest-keypair-362163077',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:17:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-uxsd1q0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=93812981-7340-4edb-9687-008c40475bf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "address": "fa:16:3e:e1:2d:57", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff3f80c-a6", "ovs_interfaceid": "7ff3f80c-a6c8-41d9-89e3-9f6121a76640", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG os_vif [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff3f80c-a6, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32cf7f03-d5ab-4c1f-982d-fcfcfce896bb) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:17 user nova-compute[75051]: INFO os_vif [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:2d:57,bridge_name='br-int',has_traffic_filtering=True,id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff3f80c-a6')
Nov 24 19:20:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Deleting instance files /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9_del
Nov 24 19:20:17 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Deletion of /opt/stack/data/nova/instances/93812981-7340-4edb-9687-008c40475bf9_del complete
Nov 24 19:20:17 user nova-compute[75051]: INFO nova.compute.manager [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: 93812981-7340-4edb-9687-008c40475bf9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 19:20:17 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:20:17 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:20:18 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 93812981-7340-4edb-9687-008c40475bf9] Took 0.95 seconds to deallocate network for instance.
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-da3c25f5-a111-42ee-b29c-d990f942b1aa req-2ac617b7-9c38-47e4-9d85-87555798e02c service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-deleted-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:18 user nova-compute[75051]: INFO nova.compute.manager [req-da3c25f5-a111-42ee-b29c-d990f942b1aa req-2ac617b7-9c38-47e4-9d85-87555798e02c service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Neutron deleted interface 7ff3f80c-a6c8-41d9-89e3-9f6121a76640; detaching it from the instance and deleting it from the info cache
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.network.neutron [req-da3c25f5-a111-42ee-b29c-d990f942b1aa req-2ac617b7-9c38-47e4-9d85-87555798e02c service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-da3c25f5-a111-42ee-b29c-d990f942b1aa req-2ac617b7-9c38-47e4-9d85-87555798e02c service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Detach interface failed, port_id=7ff3f80c-a6c8-41d9-89e3-9f6121a76640, reason: Instance 93812981-7340-4edb-9687-008c40475bf9 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:18 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Deleted allocations for instance 93812981-7340-4edb-9687-008c40475bf9
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-00ba8d32-6f99-4ca9-ad9a-cebc606b4e6d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "93812981-7340-4edb-9687-008c40475bf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] Acquiring lock "93812981-7340-4edb-9687-008c40475bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] Lock "93812981-7340-4edb-9687-008c40475bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] No waiting events found dispatching network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:18 user nova-compute[75051]: WARNING nova.compute.manager [req-643cafbe-1b4c-46a6-b8ec-833f13dabae9 req-f12b728c-d87e-4be5-ac97-c6a8454665fa service nova] [instance: 93812981-7340-4edb-9687-008c40475bf9] Received unexpected event network-vif-plugged-7ff3f80c-a6c8-41d9-89e3-9f6121a76640 for instance with vm_state deleted and task_state None.
Nov 24 19:20:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:20:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:25 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:26 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:20:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8599MB free_disk=25.181861877441406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1fb902b2-7af2-41b9-af98-bede938c480e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:20:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:30 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1fb902b2-7af2-41b9-af98-bede938c480e is timed out.
Nov 24 19:20:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully detached device vdc from instance 1fb902b2-7af2-41b9-af98-bede938c480e from the live domain config.
Nov 24 19:20:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pidJfzLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:20:30 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30864da-4801-40a9-8879-b887f174d2e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:20:30 user nova-compute[75051]: No targets found.
Nov 24 19:20:30 user nova-compute[75051]: iSNS:
Nov 24 19:20:30 user nova-compute[75051]: No targets found.
Nov 24 19:20:30 user nova-compute[75051]: STATIC:
Nov 24 19:20:30 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48
Nov 24 19:20:30 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:20:30 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:20:30 user nova-compute[75051]: FIRMWARE:
Nov 24 19:20:30 user nova-compute[75051]: No targets found.
Nov 24 19:20:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:20:30 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:20:30 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6397d9fc-2899-482f-b796-8a4f0cb4985c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cc58fb-5de5-4c21-bcb8-eb0ab4b9cb12]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:20:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 (non-flash)
Nov 24 19:20:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0383d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48'): ({'sde'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Removing single pathed devices sde {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[abefe706-5433-46f6-b7f9-c725d1066f37]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c5c9d-1733-41cb-a31e-3a079d42cd64]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Flushing IO for device /dev/sde {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:20:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e16b0e-c773-4f3c-8993-79a0dff5aac5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ef4df-8051-4e5d-a289-598ee0ec90b5]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] SCSI volumes sde have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ad5c13-dc47-44c1-821b-808fad113240]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be221661-997f-4ec4-b17a-c4214b6dd483]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260]
Nov 24 19:20:31 user nova-compute[75051]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48, portal: 172.16.0.220,3260] successful.
Nov 24 19:20:31 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:625b5253-8be6-4f28-bc73-209b1c84ea48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad9fa3-abe3-4650-b1a9-9fd373c594ba]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] <== disconnect_volume: return (281ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:20:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'flavor' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a9950cd2-4a43-449f-b7d3-c287d12c65fb tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:32 user nova-compute[75051]: INFO nova.compute.manager [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Terminating instance
Nov 24 19:20:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-08854474-f314-4e6f-9c57-c150e12d9bd7 req-51e41c1a-083b-455b-a6aa-7a1082b0516f service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-unplugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Instance destroyed successfully.
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lazy-loading 'resources' on Instance uuid 430f20f2-3d8d-452b-a410-c4f05e32d7aa {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-350445351',display_name='tempest-TestMinimumBasicScenario-server-350445351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-350445351',id=35,image_ref='fce932bd-514d-49d8-9800-cff955564df1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPbpgWBac6zkHkBpThTOniCqiteq5pxXM3iAtq0neRSVz4gG2yMjZTVm0Rtw4bBj1xgN07uO28iBzp82wI6zypOjHaXVdhUzwcWflJJ45xL1spctEG8Z1oJ+nizl3Bw3A==',key_name='tempest-TestMinimumBasicScenario-538818214',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:15:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3dd3c174a2f54797b24dba9c5eab26fa',ramdisk_id='',reservation_id='r-0fyvqsw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fce932bd-514d-49d8-9800-cff955564df1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-351181186',owner_user_name='tempest-TestMinimumBasicScenario-351181186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:17:55Z,user_data=None,user_id='4e7cd8f02d33451dab0dd657dae58e5e',uuid=430f20f2-3d8d-452b-a410-c4f05e32d7aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converting VIF {"id": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "address": "fa:16:3e:38:ce:7b", "network": {"id": "94c36b35-9550-452e-9885-ba13e253c45a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-178556954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3dd3c174a2f54797b24dba9c5eab26fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b40a71-9e", "ovs_interfaceid": "b7b40a71-9e06-4179-9167-c86bdcbf8518", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG os_vif [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b40a71-9e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.compute.manager [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Terminating instance
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6eb5852-4468-43eb-98c6-c0d32f087d06) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:33 user nova-compute[75051]: INFO os_vif [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:ce:7b,bridge_name='br-int',has_traffic_filtering=True,id=b7b40a71-9e06-4179-9167-c86bdcbf8518,network=Network(94c36b35-9550-452e-9885-ba13e253c45a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7b40a71-9e')
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Deleting instance files /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa_del
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Deletion of /opt/stack/data/nova/instances/430f20f2-3d8d-452b-a410-c4f05e32d7aa_del complete
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.compute.manager [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-unplugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] No waiting events found dispatching network-vif-unplugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-bd3b49bd-6cb0-4710-a34f-ed52f1f44509 req-406dc21f-8355-4e94-ba3a-025809f4a0d9 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-unplugged-97a03c11-371d-47c0-96c6-8724efdce6a5 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:20:33 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Took 0.55 seconds to deallocate network for instance.
Nov 24 19:20:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-c6420ca0-b4bd-402b-8345-2c316074856e req-c1087c12-a83f-4807-ba63-a6e5cec96aac service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-deleted-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Instance destroyed successfully.
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lazy-loading 'resources' on Instance uuid 1fb902b2-7af2-41b9-af98-bede938c480e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:17:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1306534104',display_name='tempest-AttachVolumeTestJSON-server-1306534104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1306534104',id=38,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF8QbWZkLhmWWY3RcALaBAMPnUJLG0ro0DreE/UB+3GjuFlmHqtm204T1jI5Y43lIjFaDXpat880xRJSfT1uvNSptfb15O72c8dEAUL6wxQW5ULyuvt8wMBA8H1m/Z1Q==',key_name='tempest-keypair-1676318082',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c07aa581fa647a39092777af5ee366d',ramdisk_id='',reservation_id='r-iedgeqx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-866610194',owner_user_name='tempest-AttachVolumeTestJSON-866610194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='623c9f272b0e44f1a14364d1f90fc762',uuid=1fb902b2-7af2-41b9-af98-bede938c480e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converting VIF {"id": "97a03c11-371d-47c0-96c6-8724efdce6a5", "address": "fa:16:3e:31:f3:0c", "network": {"id": "4e5ed21a-b945-4835-87e9-1a6ebb44e599", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1183370038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c07aa581fa647a39092777af5ee366d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97a03c11-37", "ovs_interfaceid": "97a03c11-371d-47c0-96c6-8724efdce6a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG os_vif [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97a03c11-37, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d511288d-4d61-47f5-9c05-40d4f437308a) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:34 user nova-compute[75051]: INFO os_vif [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f3:0c,bridge_name='br-int',has_traffic_filtering=True,id=97a03c11-371d-47c0-96c6-8724efdce6a5,network=Network(4e5ed21a-b945-4835-87e9-1a6ebb44e599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97a03c11-37')
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Deleting instance files /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e_del
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Deletion of /opt/stack/data/nova/instances/1fb902b2-7af2-41b9-af98-bede938c480e_del complete
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.compute.manager [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Deleted allocations for instance 430f20f2-3d8d-452b-a410-c4f05e32d7aa
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-89e59477-8a9d-4ed4-b6b6-f6e1a5dc337c tempest-TestMinimumBasicScenario-351181186 tempest-TestMinimumBasicScenario-351181186-project-member] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.990s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:20:34 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Took 0.62 seconds to deallocate network for instance.
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] Acquiring lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] Lock "430f20f2-3d8d-452b-a410-c4f05e32d7aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] No waiting events found dispatching network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:34 user nova-compute[75051]: WARNING nova.compute.manager [req-83e78ab4-a584-48b4-86d6-3f5ffa871eb8 req-9be50be1-5b2c-4354-91f3-42b1436d3bc4 service nova] [instance: 430f20f2-3d8d-452b-a410-c4f05e32d7aa] Received unexpected event network-vif-plugged-b7b40a71-9e06-4179-9167-c86bdcbf8518 for instance with vm_state deleted and task_state None.
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:35 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Deleted allocations for instance 1fb902b2-7af2-41b9-af98-bede938c480e
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ca1b82ba-b9ee-4e78-bd7c-62c5d83e2913 tempest-AttachVolumeTestJSON-866610194 tempest-AttachVolumeTestJSON-866610194-project-member] Lock "1fb902b2-7af2-41b9-af98-bede938c480e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] Acquiring lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] Lock "1fb902b2-7af2-41b9-af98-bede938c480e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] No waiting events found dispatching network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:20:35 user nova-compute[75051]: WARNING nova.compute.manager [req-a99169c9-d55a-474d-a436-41e17b9d0ba0 req-9ac9601b-8783-4237-9569-ad3571f68dc0 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received unexpected event network-vif-plugged-97a03c11-371d-47c0-96c6-8724efdce6a5 for instance with vm_state deleted and task_state None.
Nov 24 19:20:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:35 user nova-compute[75051]: DEBUG nova.compute.manager [req-eecde065-c170-4859-9817-df0013e52cdc req-10470229-dbf4-44f7-b79a-c038bb73a476 service nova] [instance: 1fb902b2-7af2-41b9-af98-bede938c480e] Received event network-vif-deleted-97a03c11-371d-47c0-96c6-8724efdce6a5 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:20:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:38 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:20:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:20:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:20:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:20:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:21:10 user nova-compute[75051]: INFO nova.compute.claims [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Claim successful on node user
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:21:10 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.policy [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b2c20e8819f346e8b5c57a77becb0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3182a5d4540cfab6a2a919f79f3b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:21:10 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Creating image(s)
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk 1073741824" returned: 0 in 0.079s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Successfully created port: 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Cannot resize image /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Ensure instance console log exists: /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Successfully updated port: 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing instance network info cache due to event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2151512c-3b7e-42f0-a7ac-0db3ebb55316 req-e20961b6-3dc9-47da-a3b1-ba59d9e1b54c service nova] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:21:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance network_info: |[{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start _get_guest_xml network_info=[{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:21:12 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:12 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4cr6rg+r6Pe7I4MJi9VKZq/gi2qB73DlVlEmCvQcomaO3Zus923DoJZEJx8uhdnXfC2U4Mh+500hWYY2xvRF5kCrB9Mj9Z0K+4UC8OLAkXw3BxXjxP1USfhzEslZ8aiA==',key_name='tempest-keypair-1496395464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_devices' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:21:12 user nova-compute[75051]:   <uuid>fbd33518-daa7-4be8-bd55-89f457eff75b</uuid>
Nov 24 19:21:12 user nova-compute[75051]:   <name>instance-00000027</name>
Nov 24 19:21:12 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:21:12 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:21:12 user nova-compute[75051]:   <metadata>
Nov 24 19:21:12 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:21:12 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1166797930</nova:name>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:21:12</nova:creationTime>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:21:12 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:21:12 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:owner>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:user uuid="b2c20e8819f346e8b5c57a77becb0c68">tempest-AttachVolumeShelveTestJSON-1174395931-project-member</nova:user>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:project uuid="6cc3182a5d4540cfab6a2a919f79f3b9">tempest-AttachVolumeShelveTestJSON-1174395931</nova:project>
Nov 24 19:21:12 user nova-compute[75051]:       </nova:owner>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:21:12 user nova-compute[75051]:       <nova:ports>
Nov 24 19:21:12 user nova-compute[75051]:         <nova:port uuid="03178b6b-652c-4257-b50b-d8ceb6efa63c">
Nov 24 19:21:12 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:21:12 user nova-compute[75051]:         </nova:port>
Nov 24 19:21:12 user nova-compute[75051]:       </nova:ports>
Nov 24 19:21:12 user nova-compute[75051]:     </nova:instance>
Nov 24 19:21:12 user nova-compute[75051]:   </metadata>
Nov 24 19:21:12 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:21:12 user nova-compute[75051]:     <system>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="serial">fbd33518-daa7-4be8-bd55-89f457eff75b</entry>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="uuid">fbd33518-daa7-4be8-bd55-89f457eff75b</entry>
Nov 24 19:21:12 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:21:12 user nova-compute[75051]:     </system>
Nov 24 19:21:12 user nova-compute[75051]:   </sysinfo>
Nov 24 19:21:12 user nova-compute[75051]:   <os>
Nov 24 19:21:12 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:21:12 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:21:12 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:21:12 user nova-compute[75051]:   </os>
Nov 24 19:21:12 user nova-compute[75051]:   <features>
Nov 24 19:21:12 user nova-compute[75051]:     <acpi/>
Nov 24 19:21:12 user nova-compute[75051]:     <apic/>
Nov 24 19:21:12 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:21:12 user nova-compute[75051]:   </features>
Nov 24 19:21:12 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:21:12 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:21:12 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:21:12 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:21:12 user nova-compute[75051]:   </clock>
Nov 24 19:21:12 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:21:12 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:21:12 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:21:12 user nova-compute[75051]:   </cpu>
Nov 24 19:21:12 user nova-compute[75051]:   <devices>
Nov 24 19:21:12 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:21:12 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:21:12 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk"/>
Nov 24 19:21:12 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:21:12 user nova-compute[75051]:     </disk>
Nov 24 19:21:12 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:21:12 user nova-compute[75051]:       <mac address="fa:16:3e:bf:4f:d7"/>
Nov 24 19:21:12 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:12 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:21:12 user nova-compute[75051]:       <target dev="tap03178b6b-65"/>
Nov 24 19:21:12 user nova-compute[75051]:     </interface>
Nov 24 19:21:12 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:21:12 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/console.log" append="off"/>
Nov 24 19:21:12 user nova-compute[75051]:     </serial>
Nov 24 19:21:12 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:21:12 user nova-compute[75051]:     <video>
Nov 24 19:21:12 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:12 user nova-compute[75051]:     </video>
Nov 24 19:21:12 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:21:12 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:21:12 user nova-compute[75051]:     </rng>
Nov 24 19:21:12 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:21:12 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:21:12 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:21:12 user nova-compute[75051]:     </memballoon>
Nov 24 19:21:12 user nova-compute[75051]:   </devices>
Nov 24 19:21:12 user nova-compute[75051]: </domain>
Nov 24 19:21:12 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4cr6rg+r6Pe7I4MJi9VKZq/gi2qB73DlVlEmCvQcomaO3Zus923DoJZEJx8uhdnXfC2U4Mh+500hWYY2xvRF5kCrB9Mj9Z0K+4UC8OLAkXw3BxXjxP1USfhzEslZ8aiA==',key_name='tempest-keypair-1496395464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG os_vif [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c9667c1-0ba8-55ab-b03b-eeff2c4880e5', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03178b6b-65, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03178b6b-65, col_values=(('qos', UUID('483a1e6a-811d-422c-9bc8-9144bc27faae')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03178b6b-65, col_values=(('external_ids', {'iface-id': '03178b6b-652c-4257-b50b-d8ceb6efa63c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:4f:d7', 'vm-uuid': 'fbd33518-daa7-4be8-bd55-89f457eff75b'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:12 user nova-compute[75051]: INFO os_vif [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65')
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:21:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No VIF found with MAC fa:16:3e:bf:4f:d7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:21:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:14 user nova-compute[75051]: WARNING nova.compute.manager [req-73047a07-4089-419f-870d-778d53ca4352 req-6688bd44-04a3-4b21-8a45-41da35462cfd service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state building and task_state spawning.
Nov 24 19:21:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:21:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance spawned successfully.
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:16 user nova-compute[75051]: WARNING nova.compute.manager [req-387c53ee-ce15-44ec-a8fa-f916f0acf5ff req-91a5be43-fbce-4817-b4e5-dc90edc36e86 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state building and task_state spawning.
Nov 24 19:21:16 user nova-compute[75051]: INFO nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 24 19:21:16 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:21:16 user nova-compute[75051]: INFO nova.compute.manager [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Took 6.33 seconds to build instance.
Nov 24 19:21:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e2f68e1d-bfb5-4c35-9ed9-8631cd2a5b3a tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.428s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:24 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:21:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.274860382080078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fbd33518-daa7-4be8-bd55-89f457eff75b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:21:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:33 user nova-compute[75051]: INFO nova.compute.manager [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Rescuing
Nov 24 19:21:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:21:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:21:33 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.network.neutron [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.compute.manager [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:34 user nova-compute[75051]: WARNING nova.compute.manager [req-6906b58f-7710-4c4e-b029-0f61037ed667 req-3c50c54e-a15e-41df-9aa3-0d56ba227ebd service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state active and task_state rescuing.
Nov 24 19:21:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance destroyed successfully.
Nov 24 19:21:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Attempting rescue
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 19:21:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Creating image(s)
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.191s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue" returned: 0 in 0.064s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'migration_context' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.base [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<7efb1743-512a-4bda-9930-b03c160b98f6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start _get_guest_xml network_info=[{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:e2:03:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.base [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<7efb1743-512a-4bda-9930-b03c160b98f6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'numa_topology' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.base [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<7efb1743-512a-4bda-9930-b03c160b98f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:21:35 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:35 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.base [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<7efb1743-512a-4bda-9930-b03c160b98f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-868253231',display_name='tempest-ServerRescueNegativeTestJSON-server-868253231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-868253231',id=36,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-hqfjo7lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:16:57Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=7efb1743-512a-4bda-9930-b03c160b98f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:e2:03:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:e2:03:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.objects.base [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<7efb1743-512a-4bda-9930-b03c160b98f6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:21:35 user nova-compute[75051]:   <uuid>7efb1743-512a-4bda-9930-b03c160b98f6</uuid>
Nov 24 19:21:35 user nova-compute[75051]:   <name>instance-00000024</name>
Nov 24 19:21:35 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:21:35 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:21:35 user nova-compute[75051]:   <metadata>
Nov 24 19:21:35 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:21:35 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-868253231</nova:name>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:21:35</nova:creationTime>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:21:35 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:21:35 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:owner>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:21:35 user nova-compute[75051]:       </nova:owner>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:21:35 user nova-compute[75051]:       <nova:ports>
Nov 24 19:21:35 user nova-compute[75051]:         <nova:port uuid="350e9cdb-e02f-41cc-853f-50b905a93655">
Nov 24 19:21:35 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 19:21:35 user nova-compute[75051]:         </nova:port>
Nov 24 19:21:35 user nova-compute[75051]:       </nova:ports>
Nov 24 19:21:35 user nova-compute[75051]:     </nova:instance>
Nov 24 19:21:35 user nova-compute[75051]:   </metadata>
Nov 24 19:21:35 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:21:35 user nova-compute[75051]:     <system>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="serial">7efb1743-512a-4bda-9930-b03c160b98f6</entry>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="uuid">7efb1743-512a-4bda-9930-b03c160b98f6</entry>
Nov 24 19:21:35 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:21:35 user nova-compute[75051]:     </system>
Nov 24 19:21:35 user nova-compute[75051]:   </sysinfo>
Nov 24 19:21:35 user nova-compute[75051]:   <os>
Nov 24 19:21:35 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:21:35 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:21:35 user nova-compute[75051]:   </os>
Nov 24 19:21:35 user nova-compute[75051]:   <features>
Nov 24 19:21:35 user nova-compute[75051]:     <acpi/>
Nov 24 19:21:35 user nova-compute[75051]:     <apic/>
Nov 24 19:21:35 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:21:35 user nova-compute[75051]:   </features>
Nov 24 19:21:35 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:21:35 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:21:35 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:21:35 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:21:35 user nova-compute[75051]:   </clock>
Nov 24 19:21:35 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:21:35 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:21:35 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:21:35 user nova-compute[75051]:   </cpu>
Nov 24 19:21:35 user nova-compute[75051]:   <devices>
Nov 24 19:21:35 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:21:35 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:21:35 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue"/>
Nov 24 19:21:35 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:21:35 user nova-compute[75051]:     </disk>
Nov 24 19:21:35 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:21:35 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:21:35 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk"/>
Nov 24 19:21:35 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:21:35 user nova-compute[75051]:     </disk>
Nov 24 19:21:35 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:21:35 user nova-compute[75051]:       <mac address="fa:16:3e:e2:03:b8"/>
Nov 24 19:21:35 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:35 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:21:35 user nova-compute[75051]:       <target dev="tap350e9cdb-e0"/>
Nov 24 19:21:35 user nova-compute[75051]:     </interface>
Nov 24 19:21:35 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:21:35 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/console.log" append="off"/>
Nov 24 19:21:35 user nova-compute[75051]:     </serial>
Nov 24 19:21:35 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:21:35 user nova-compute[75051]:     <video>
Nov 24 19:21:35 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:35 user nova-compute[75051]:     </video>
Nov 24 19:21:35 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:21:35 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:21:35 user nova-compute[75051]:     </rng>
Nov 24 19:21:35 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:21:35 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:21:35 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:21:35 user nova-compute[75051]:     </memballoon>
Nov 24 19:21:35 user nova-compute[75051]:   </devices>
Nov 24 19:21:35 user nova-compute[75051]: </domain>
Nov 24 19:21:35 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:21:35 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance destroyed successfully.
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:e2:03:b8, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG nova.compute.manager [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:36 user nova-compute[75051]: WARNING nova.compute.manager [req-cbd1458d-9c28-4ed9-8fef-73f4fd01cd45 req-7fb30f0d-e481-4d27-bf5a-d40c6ceb8044 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state active and task_state rescuing.
Nov 24 19:21:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:38 user nova-compute[75051]: WARNING nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state active and task_state rescuing.
Nov 24 19:21:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:38 user nova-compute[75051]: WARNING nova.compute.manager [req-cd73809b-bc9b-456b-b9d6-b8a780fb482d req-ef71f6e3-1dcf-45df-bf0c-8205c4196f9e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state active and task_state rescuing.
Nov 24 19:21:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5b8f0c32-83ef-44d3-b0d2-ad6cbe4afbd5 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:21:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:21:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:21:48 user nova-compute[75051]: INFO nova.compute.claims [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Claim successful on node user
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:21:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.policy [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '918f479d20f449848b5b088b6aaf64d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c244443230f42adbf13dbcb8405247e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:21:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Creating image(s)
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "/opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:48 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.197s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk 1073741824" returned: 0 in 0.061s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Successfully created port: 8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Cannot resize image /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Ensure instance console log exists: /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Successfully updated port: 8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-changed-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.compute.manager [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Refreshing instance network info cache due to event network-changed-8eec7d63-224e-48a2-9569-2528c186a51c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] Acquiring lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] Acquired lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Refreshing network info cache for port 8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c1c61237-bff5-41d8-acb3-77fe35aa0a63 req-335c0f48-5760-4033-8b37-a31f9de614ea service nova] Releasing lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquired lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating instance_info_cache with network_info: [{"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Releasing lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance network_info: |[{"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Start _get_guest_xml network_info=[{"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:21:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304362412',display_name='tempest-AttachVolumeNegativeTest-server-304362412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304362412',id=40,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Wa77hQHmrT5+zTIU2wKFMZLkID0QrCmsfc5rimkEWBxeQzDyE6c9b8bhRVv9bAe62OcgEWTlet1Rz/PkioNNIYEfHeQTiOk//OQfrh+44Urb/oFeYSGPxMTTgIRtcyw==',key_name='tempest-keypair-178512177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-56qruixo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=e54115c0-091c-4889-91eb-fb7a0a97e9c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'pci_devices' on Instance uuid e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:21:50 user nova-compute[75051]:   <uuid>e54115c0-091c-4889-91eb-fb7a0a97e9c3</uuid>
Nov 24 19:21:50 user nova-compute[75051]:   <name>instance-00000028</name>
Nov 24 19:21:50 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:21:50 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:21:50 user nova-compute[75051]:   <metadata>
Nov 24 19:21:50 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:21:50 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeNegativeTest-server-304362412</nova:name>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:21:50</nova:creationTime>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:21:50 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:21:50 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:owner>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:user uuid="918f479d20f449848b5b088b6aaf64d7">tempest-AttachVolumeNegativeTest-1689022931-project-member</nova:user>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:project uuid="0c244443230f42adbf13dbcb8405247e">tempest-AttachVolumeNegativeTest-1689022931</nova:project>
Nov 24 19:21:50 user nova-compute[75051]:       </nova:owner>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:21:50 user nova-compute[75051]:       <nova:ports>
Nov 24 19:21:50 user nova-compute[75051]:         <nova:port uuid="8eec7d63-224e-48a2-9569-2528c186a51c">
Nov 24 19:21:50 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:21:50 user nova-compute[75051]:         </nova:port>
Nov 24 19:21:50 user nova-compute[75051]:       </nova:ports>
Nov 24 19:21:50 user nova-compute[75051]:     </nova:instance>
Nov 24 19:21:50 user nova-compute[75051]:   </metadata>
Nov 24 19:21:50 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:21:50 user nova-compute[75051]:     <system>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="serial">e54115c0-091c-4889-91eb-fb7a0a97e9c3</entry>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="uuid">e54115c0-091c-4889-91eb-fb7a0a97e9c3</entry>
Nov 24 19:21:50 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:21:50 user nova-compute[75051]:     </system>
Nov 24 19:21:50 user nova-compute[75051]:   </sysinfo>
Nov 24 19:21:50 user nova-compute[75051]:   <os>
Nov 24 19:21:50 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:21:50 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:21:50 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:21:50 user nova-compute[75051]:   </os>
Nov 24 19:21:50 user nova-compute[75051]:   <features>
Nov 24 19:21:50 user nova-compute[75051]:     <acpi/>
Nov 24 19:21:50 user nova-compute[75051]:     <apic/>
Nov 24 19:21:50 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:21:50 user nova-compute[75051]:   </features>
Nov 24 19:21:50 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:21:50 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:21:50 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:21:50 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:21:50 user nova-compute[75051]:   </clock>
Nov 24 19:21:50 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:21:50 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:21:50 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:21:50 user nova-compute[75051]:   </cpu>
Nov 24 19:21:50 user nova-compute[75051]:   <devices>
Nov 24 19:21:50 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:21:50 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:21:50 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk"/>
Nov 24 19:21:50 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:21:50 user nova-compute[75051]:     </disk>
Nov 24 19:21:50 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:21:50 user nova-compute[75051]:       <mac address="fa:16:3e:fb:fc:55"/>
Nov 24 19:21:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:50 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:21:50 user nova-compute[75051]:       <target dev="tap8eec7d63-22"/>
Nov 24 19:21:50 user nova-compute[75051]:     </interface>
Nov 24 19:21:50 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:21:50 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/console.log" append="off"/>
Nov 24 19:21:50 user nova-compute[75051]:     </serial>
Nov 24 19:21:50 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:21:50 user nova-compute[75051]:     <video>
Nov 24 19:21:50 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:21:50 user nova-compute[75051]:     </video>
Nov 24 19:21:50 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:21:50 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:21:50 user nova-compute[75051]:     </rng>
Nov 24 19:21:50 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:21:50 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:21:50 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:21:50 user nova-compute[75051]:     </memballoon>
Nov 24 19:21:50 user nova-compute[75051]:   </devices>
Nov 24 19:21:50 user nova-compute[75051]: </domain>
Nov 24 19:21:50 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304362412',display_name='tempest-AttachVolumeNegativeTest-server-304362412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304362412',id=40,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Wa77hQHmrT5+zTIU2wKFMZLkID0QrCmsfc5rimkEWBxeQzDyE6c9b8bhRVv9bAe62OcgEWTlet1Rz/PkioNNIYEfHeQTiOk//OQfrh+44Urb/oFeYSGPxMTTgIRtcyw==',key_name='tempest-keypair-178512177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-56qruixo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:21:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=e54115c0-091c-4889-91eb-fb7a0a97e9c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG os_vif [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79fb1fe1-2c1c-5eea-aa64-faa0e299115c', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eec7d63-22, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eec7d63-22, col_values=(('qos', UUID('cd3bee8e-3e07-4e6c-bd36-867f148db60c')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eec7d63-22, col_values=(('external_ids', {'iface-id': '8eec7d63-224e-48a2-9569-2528c186a51c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:fc:55', 'vm-uuid': 'e54115c0-091c-4889-91eb-fb7a0a97e9c3'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:50 user nova-compute[75051]: INFO os_vif [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22')
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:21:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:fb:fc:55, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG nova.compute.manager [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:52 user nova-compute[75051]: WARNING nova.compute.manager [req-f4386837-dc2d-4ebb-9a3c-928013acf5bb req-5f33078d-83db-4064-afea-d24d245fc2cc service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state building and task_state spawning.
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:21:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance spawned successfully.
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:21:54 user nova-compute[75051]: INFO nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:21:54 user nova-compute[75051]: WARNING nova.compute.manager [req-035ebd20-db0e-44b2-9b9c-169ce5751a5e req-dfffd45d-f8a3-4a37-b5e8-2463f1e20b49 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state building and task_state spawning.
Nov 24 19:21:54 user nova-compute[75051]: INFO nova.compute.manager [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Took 6.21 seconds to build instance.
Nov 24 19:21:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f2b09ef3-56eb-4de5-b6f1-3d0a39f2ccbf tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.297s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:21:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:21:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:22:26 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:27 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:22:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:22:29 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=25.207077026367188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fbd33518-daa7-4be8-bd55-89f457eff75b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:22:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:22:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:22:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:22:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:22:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing instance network info cache due to event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:23:01 user nova-compute[75051]: DEBUG nova.network.neutron [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updated VIF entry in instance network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:23:01 user nova-compute[75051]: DEBUG nova.network.neutron [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-25c9b236-3c57-4e9c-96b1-241a345bb996 req-1592c3ab-c30b-42f2-9cc3-9aa6eb1b27c2 service nova] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:04 user nova-compute[75051]: INFO nova.compute.manager [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Shelving
Nov 24 19:23:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:04 user nova-compute[75051]: WARNING nova.compute.manager [req-73c3d88e-f9d0-4a01-93a2-2d5cdd686ace req-090262b9-2a47-42b1-98a1-69522cc28754 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state active and task_state shelving.
Nov 24 19:23:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance destroyed successfully.
Nov 24 19:23:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Beginning cold snapshot process
Nov 24 19:23:05 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:23:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk /opt/stack/data/nova/instances/snapshots/tmpbr6chh2x/7f232bb319304fbd85dd7fbc55ed1313 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk /opt/stack/data/nova/instances/snapshots/tmpbr6chh2x/7f232bb319304fbd85dd7fbc55ed1313" returned: 0 in 0.537s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Snapshot extracted, beginning image upload
Nov 24 19:23:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:06 user nova-compute[75051]: WARNING nova.compute.manager [req-f1ee241f-7070-4fd9-89cb-1664b3995af5 req-5700f4d0-ed79-4cda-aaa7-e988b75cb18f service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state active and task_state shelving_image_uploading.
Nov 24 19:23:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Snapshot image upload complete
Nov 24 19:23:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:23:08 user nova-compute[75051]: INFO nova.compute.manager [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Shelve offloading
Nov 24 19:23:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance destroyed successfully.
Nov 24 19:23:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:23:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:23:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance destroyed successfully.
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'resources' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4cr6rg+r6Pe7I4MJi9VKZq/gi2qB73DlVlEmCvQcomaO3Zus923DoJZEJx8uhdnXfC2U4Mh+500hWYY2xvRF5kCrB9Mj9Z0K+4UC8OLAkXw3BxXjxP1USfhzEslZ8aiA==',key_name='tempest-keypair-1496395464',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:23:08.308652',shelved_host='user',shelved_image_id='55a0cb02-ae0b-4468-b17e-febac02ad14f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:23:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG os_vif [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing instance network info cache due to event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03178b6b-65, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=483a1e6a-811d-422c-9bc8-9144bc27faae) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:09 user nova-compute[75051]: INFO os_vif [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65')
Nov 24 19:23:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Deleting instance files /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b_del
Nov 24 19:23:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Deletion of /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b_del complete
Nov 24 19:23:09 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Deleted allocations for instance fbd33518-daa7-4be8-bd55-89f457eff75b
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'numa_topology' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.objects.base [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<fbd33518-daa7-4be8-bd55-89f457eff75b> lazy-loaded attributes: resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updated VIF entry in instance network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG nova.network.neutron [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap03178b6b-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f6f1d58e-a138-493b-9071-826050f759cd tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.310s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2bc97aed-846d-4f9d-9c42-0e63c6cd1f13 req-9c99085b-cff0-4b76-b4e2-1e280045e25d service nova] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:24 user nova-compute[75051]: INFO nova.compute.manager [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Unrescuing
Nov 24 19:23:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:23:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:25 user nova-compute[75051]: DEBUG nova.objects.instance [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'flavor' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:26 user nova-compute[75051]: WARNING nova.compute.manager [req-6519bd27-b7e2-4979-80bd-42545d78f051 req-af06b4f9-e35a-456b-afcc-622693cb660f service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:23:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:26 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance destroyed successfully.
Nov 24 19:23:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:23:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:28 user nova-compute[75051]: WARNING nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:23:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:28 user nova-compute[75051]: WARNING nova.compute.manager [req-d33d9600-5232-4384-9fd5-2dd1f457fb21 req-e8ea858e-3b25-4b5c-bbe1-931859e9a066 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:29 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.manager [None req-641fcb32-99dd-46d5-9c43-8e10bca5fe79 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.manager [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:23:30 user nova-compute[75051]: WARNING nova.compute.manager [req-44e7b752-a489-400e-a57d-ff53e73cdc83 req-6b76fcec-9e97-4e89-aedf-c78204b9fa32 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:23:30 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:23:30 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8759MB free_disk=25.185165405273438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:23:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:34 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:23:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-changed-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Refreshing instance network info cache due to event network-changed-8eec7d63-224e-48a2-9569-2528c186a51c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] Acquiring lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] Acquired lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Refreshing network info cache for port 8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updated VIF entry in instance network info cache for port 8eec7d63-224e-48a2-9569-2528c186a51c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating instance_info_cache with network_info: [{"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8b87a740-5847-42d9-a2a8-caef3e193885 req-16a55782-d97f-4f72-9ece-e410fcc2ba2a service nova] Releasing lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:41 user nova-compute[75051]: INFO nova.compute.manager [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Attaching volume 420a58d1-e044-41d4-8fee-573b2c0d02d1 to /dev/vdb
Nov 24 19:23:41 user nova-compute[75051]: DEBUG os_brick.utils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:23:41 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c45731-c6a1-42a0-b2c3-06551362262b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f94c2f-fcbf-4d41-b76e-12f116c0d3e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60625e2-80cd-4047-87f0-20778da0bafa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33513932-23e0-42b4-99a8-8569d90e2ec5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:23:42 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d086ef41-eb0c-4e75-bcb4-0306286af74f]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG os_brick.utils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating existing volume attachment record: cc2016b1-fb53-4a09-9c34-ea5051c9d933 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:23:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdEsHDTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:23:49 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:23:49 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:23:49 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb23c4e-9478-4c81-b77f-98380139a9fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:23:49 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946656d-4db5-457e-be7d-ff15646dbff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1] added
Nov 24 19:23:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d865d4e5-141b-4380-a18a-bda2a9616cf5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fe15a2-d315-4c03-92ce-e4532f7cf3a1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdEsHDTi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdEsHDTi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d653c31-1e6a-4120-8ca8-c4ac96f6d13d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XdEsHDTi'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f70ae-7806-4c3c-9866-9579ee764d09]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb617256-4aae-46fa-b3fa-451d40c00558]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:23:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:23:50 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:23:50 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:23:50 user nova-compute[75051]: 
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b3a8e-80da-468c-8441-93d198cc2b52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260]
Nov 24 19:23:50 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260] successful.
Nov 24 19:23:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f0b0a-8a66-4a00-b211-0dd5d565e3c5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aaaac7-c4c7-43f2-9392-15cebcb841d6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)
Nov 24 19:23:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)
Nov 24 19:23:50 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5697296-b8f0-4c47-a0c8-8295673cc635]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:23:50 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdEsHDTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23161613762663061', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161613762663061', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:23:51 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:23:51 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:23:51 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:23:51 user nova-compute[75051]:   <serial>420a58d1-e044-41d4-8fee-573b2c0d02d1</serial>
Nov 24 19:23:51 user nova-compute[75051]: </disk>
Nov 24 19:23:51 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:fb:fc:55, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-704afec4-e46d-463e-a065-b5a48d85911c tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.804s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:23:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:23:56 user nova-compute[75051]: INFO nova.compute.claims [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Claim successful on node user
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:23:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.policy [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '918f479d20f449848b5b088b6aaf64d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c244443230f42adbf13dbcb8405247e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:23:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Creating image(s)
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:56 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk 1073741824" returned: 0 in 0.049s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Successfully created port: 8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Cannot resize image /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Ensure instance console log exists: /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:23:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Successfully updated port: 8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquired lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-changed-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Refreshing instance network info cache due to event network-changed-8da2eb31-7078-49b7-b47a-218ede0098f3. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] Acquiring lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updating instance_info_cache with network_info: [{"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Releasing lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Instance network_info: |[{"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] Acquired lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Refreshing network info cache for port 8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Start _get_guest_xml network_info=[{"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:23:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:23:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390775376',display_name='tempest-AttachVolumeNegativeTest-server-390775376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390775376',id=41,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUiboSvm3wCzMAcmpH3kSM8Cf0UOZxWfTa5OADkMfzIku5fmck08O3fnPy1REcQYAdUaLGmAu3owucQeqH6cC/sJPHtT6zMZ7Ef9H1USms6uOyVvMW4P1ehdDUBg1DbIQ==',key_name='tempest-keypair-757706689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-i0y7z0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=0bfc95c1-5653-48ea-9376-ece538a06899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bfc95c1-5653-48ea-9376-ece538a06899 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:23:58 user nova-compute[75051]:   <uuid>0bfc95c1-5653-48ea-9376-ece538a06899</uuid>
Nov 24 19:23:58 user nova-compute[75051]:   <name>instance-00000029</name>
Nov 24 19:23:58 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:23:58 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:23:58 user nova-compute[75051]:   <metadata>
Nov 24 19:23:58 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:23:58 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeNegativeTest-server-390775376</nova:name>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:23:58</nova:creationTime>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:23:58 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:23:58 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:owner>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:user uuid="918f479d20f449848b5b088b6aaf64d7">tempest-AttachVolumeNegativeTest-1689022931-project-member</nova:user>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:project uuid="0c244443230f42adbf13dbcb8405247e">tempest-AttachVolumeNegativeTest-1689022931</nova:project>
Nov 24 19:23:58 user nova-compute[75051]:       </nova:owner>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:23:58 user nova-compute[75051]:       <nova:ports>
Nov 24 19:23:58 user nova-compute[75051]:         <nova:port uuid="8da2eb31-7078-49b7-b47a-218ede0098f3">
Nov 24 19:23:58 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:23:58 user nova-compute[75051]:         </nova:port>
Nov 24 19:23:58 user nova-compute[75051]:       </nova:ports>
Nov 24 19:23:58 user nova-compute[75051]:     </nova:instance>
Nov 24 19:23:58 user nova-compute[75051]:   </metadata>
Nov 24 19:23:58 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:23:58 user nova-compute[75051]:     <system>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="serial">0bfc95c1-5653-48ea-9376-ece538a06899</entry>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="uuid">0bfc95c1-5653-48ea-9376-ece538a06899</entry>
Nov 24 19:23:58 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:23:58 user nova-compute[75051]:     </system>
Nov 24 19:23:58 user nova-compute[75051]:   </sysinfo>
Nov 24 19:23:58 user nova-compute[75051]:   <os>
Nov 24 19:23:58 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:23:58 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:23:58 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:23:58 user nova-compute[75051]:   </os>
Nov 24 19:23:58 user nova-compute[75051]:   <features>
Nov 24 19:23:58 user nova-compute[75051]:     <acpi/>
Nov 24 19:23:58 user nova-compute[75051]:     <apic/>
Nov 24 19:23:58 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:23:58 user nova-compute[75051]:   </features>
Nov 24 19:23:58 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:23:58 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:23:58 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:23:58 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:23:58 user nova-compute[75051]:   </clock>
Nov 24 19:23:58 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:23:58 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:23:58 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:23:58 user nova-compute[75051]:   </cpu>
Nov 24 19:23:58 user nova-compute[75051]:   <devices>
Nov 24 19:23:58 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:23:58 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:23:58 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk"/>
Nov 24 19:23:58 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:23:58 user nova-compute[75051]:     </disk>
Nov 24 19:23:58 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:23:58 user nova-compute[75051]:       <mac address="fa:16:3e:ea:e9:b0"/>
Nov 24 19:23:58 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:23:58 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:23:58 user nova-compute[75051]:       <target dev="tap8da2eb31-70"/>
Nov 24 19:23:58 user nova-compute[75051]:     </interface>
Nov 24 19:23:58 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:23:58 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/console.log" append="off"/>
Nov 24 19:23:58 user nova-compute[75051]:     </serial>
Nov 24 19:23:58 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:23:58 user nova-compute[75051]:     <video>
Nov 24 19:23:58 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:23:58 user nova-compute[75051]:     </video>
Nov 24 19:23:58 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:23:58 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:23:58 user nova-compute[75051]:     </rng>
Nov 24 19:23:58 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:23:58 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:23:58 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:23:58 user nova-compute[75051]:     </memballoon>
Nov 24 19:23:58 user nova-compute[75051]:   </devices>
Nov 24 19:23:58 user nova-compute[75051]: </domain>
Nov 24 19:23:58 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390775376',display_name='tempest-AttachVolumeNegativeTest-server-390775376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390775376',id=41,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUiboSvm3wCzMAcmpH3kSM8Cf0UOZxWfTa5OADkMfzIku5fmck08O3fnPy1REcQYAdUaLGmAu3owucQeqH6cC/sJPHtT6zMZ7Ef9H1USms6uOyVvMW4P1ehdDUBg1DbIQ==',key_name='tempest-keypair-757706689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-i0y7z0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:23:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=0bfc95c1-5653-48ea-9376-ece538a06899,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG os_vif [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f584b844-0db7-5240-993f-cd6c505d6904', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8da2eb31-70, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8da2eb31-70, col_values=(('qos', UUID('d6675d45-a8e3-4009-b4d8-7a0f170ffb58')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8da2eb31-70, col_values=(('external_ids', {'iface-id': '8da2eb31-7078-49b7-b47a-218ede0098f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e9:b0', 'vm-uuid': '0bfc95c1-5653-48ea-9376-ece538a06899'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:58 user nova-compute[75051]: INFO os_vif [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70')
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:ea:e9:b0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updated VIF entry in instance network info cache for port 8da2eb31-7078-49b7-b47a-218ede0098f3. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG nova.network.neutron [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updating instance_info_cache with network_info: [{"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:23:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-73f0624a-c3f2-4a63-9269-f7ecb679a28e req-1876df4f-7084-4272-a6a2-0341c1b16fc4 service nova] Releasing lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:23:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:23:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:24:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:24:00 user nova-compute[75051]: WARNING nova.compute.manager [req-36d31b6f-a887-4e35-a8ca-214f2679bdd7 req-112439e8-d715-41bd-80aa-a06849ac5b92 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state building and task_state spawning.
Nov 24 19:24:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:24:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Instance spawned successfully.
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:24:02 user nova-compute[75051]: INFO nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:24:02 user nova-compute[75051]: INFO nova.compute.manager [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Took 5.96 seconds to build instance.
Nov 24 19:24:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c7eab665-4bce-4537-9b43-be1a1d3590f5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:02 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:24:02 user nova-compute[75051]: WARNING nova.compute.manager [req-6a32cf39-c97b-4ce2-8707-d7d7ab05c2cc req-e162e8d2-753f-464d-80dd-15f9557a1efd service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state active and task_state None.
Nov 24 19:24:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:24:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:24:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:24:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:24:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=25.154743194580078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0bfc95c1-5653-48ea-9376-ece538a06899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:24:37 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating instance_info_cache with network_info: [{"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-e54115c0-091c-4889-91eb-fb7a0a97e9c3" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:24:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:24:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:24:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:24:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:56 user nova-compute[75051]: INFO nova.compute.manager [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Unshelving
Nov 24 19:24:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_requests' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'numa_topology' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:24:57 user nova-compute[75051]: INFO nova.compute.claims [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Claim successful on node user
Nov 24 19:24:57 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:57 user nova-compute[75051]: INFO nova.network.neutron [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating port 03178b6b-652c-4257-b50b-d8ceb6efa63c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 24 19:24:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing instance network info cache due to event network-changed-03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] Acquiring lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:24:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Creating image(s)
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] Acquired lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.network.neutron [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Refreshing network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG nova.objects.base [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<fbd33518-daa7-4be8-bd55-89f457eff75b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:24:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:24:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.part --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:24:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG nova.virt.images [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] 55a0cb02-ae0b-4468-b17e-febac02ad14f was qcow2, converting to raw {{(pid=75051) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG nova.privsep.utils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75051) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.part /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.converted {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updated VIF entry in instance network info cache for port 03178b6b-652c-4257-b50b-d8ceb6efa63c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dcec3c58-bf3f-4784-b35d-c886eda4823e req-f0b3ab87-261b-46ba-ae81-1d2e83d37f63 service nova] Releasing lock "refresh_cache-fbd33518-daa7-4be8-bd55-89f457eff75b" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.part /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.converted" returned: 0 in 0.570s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.converted --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.344s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94,backing_fmt=raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94,backing_fmt=raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk 1073741824" returned: 0 in 0.056s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "a8835f0e62c04e438c16d8815ae97a5d50df0d94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'migration_context' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG nova.objects.base [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<fbd33518-daa7-4be8-bd55-89f457eff75b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:25:01 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Rebasing disk image.
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 -F raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 -F raw /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk" returned: 0 in 2.345s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Ensure instance console log exists: /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start _get_guest_xml network_info=[{"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='81c3071b56295ce9eb5be6fd8eca70f7',container_format='bare',created_at=2023-11-24T19:23:04Z,direct_url=<?>,disk_format='qcow2',id=55a0cb02-ae0b-4468-b17e-febac02ad14f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1166797930-shelved',owner='6cc3182a5d4540cfab6a2a919f79f3b9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T19:23:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:25:04 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:04 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='81c3071b56295ce9eb5be6fd8eca70f7',container_format='bare',created_at=2023-11-24T19:23:04Z,direct_url=<?>,disk_format='qcow2',id=55a0cb02-ae0b-4468-b17e-febac02ad14f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1166797930-shelved',owner='6cc3182a5d4540cfab6a2a919f79f3b9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-24T19:23:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.objects.base [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<fbd33518-daa7-4be8-bd55-89f457eff75b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='55a0cb02-ae0b-4468-b17e-febac02ad14f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1496395464',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:23:08.308652',shelved_host='user',shelved_image_id='55a0cb02-ae0b-4468-b17e-febac02ad14f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'pci_devices' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.objects.base [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Object Instance<fbd33518-daa7-4be8-bd55-89f457eff75b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:25:04 user nova-compute[75051]:   <uuid>fbd33518-daa7-4be8-bd55-89f457eff75b</uuid>
Nov 24 19:25:04 user nova-compute[75051]:   <name>instance-00000027</name>
Nov 24 19:25:04 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:25:04 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:25:04 user nova-compute[75051]:   <metadata>
Nov 24 19:25:04 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:25:04 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1166797930</nova:name>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:25:04</nova:creationTime>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:25:04 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:25:04 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:owner>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:user uuid="b2c20e8819f346e8b5c57a77becb0c68">tempest-AttachVolumeShelveTestJSON-1174395931-project-member</nova:user>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:project uuid="6cc3182a5d4540cfab6a2a919f79f3b9">tempest-AttachVolumeShelveTestJSON-1174395931</nova:project>
Nov 24 19:25:04 user nova-compute[75051]:       </nova:owner>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:root type="image" uuid="55a0cb02-ae0b-4468-b17e-febac02ad14f"/>
Nov 24 19:25:04 user nova-compute[75051]:       <nova:ports>
Nov 24 19:25:04 user nova-compute[75051]:         <nova:port uuid="03178b6b-652c-4257-b50b-d8ceb6efa63c">
Nov 24 19:25:04 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:25:04 user nova-compute[75051]:         </nova:port>
Nov 24 19:25:04 user nova-compute[75051]:       </nova:ports>
Nov 24 19:25:04 user nova-compute[75051]:     </nova:instance>
Nov 24 19:25:04 user nova-compute[75051]:   </metadata>
Nov 24 19:25:04 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:25:04 user nova-compute[75051]:     <system>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="serial">fbd33518-daa7-4be8-bd55-89f457eff75b</entry>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="uuid">fbd33518-daa7-4be8-bd55-89f457eff75b</entry>
Nov 24 19:25:04 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:25:04 user nova-compute[75051]:     </system>
Nov 24 19:25:04 user nova-compute[75051]:   </sysinfo>
Nov 24 19:25:04 user nova-compute[75051]:   <os>
Nov 24 19:25:04 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:25:04 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:25:04 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:25:04 user nova-compute[75051]:   </os>
Nov 24 19:25:04 user nova-compute[75051]:   <features>
Nov 24 19:25:04 user nova-compute[75051]:     <acpi/>
Nov 24 19:25:04 user nova-compute[75051]:     <apic/>
Nov 24 19:25:04 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:25:04 user nova-compute[75051]:   </features>
Nov 24 19:25:04 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:25:04 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:25:04 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:25:04 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:25:04 user nova-compute[75051]:   </clock>
Nov 24 19:25:04 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:25:04 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:25:04 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:25:04 user nova-compute[75051]:   </cpu>
Nov 24 19:25:04 user nova-compute[75051]:   <devices>
Nov 24 19:25:04 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:25:04 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:25:04 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk"/>
Nov 24 19:25:04 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:25:04 user nova-compute[75051]:     </disk>
Nov 24 19:25:04 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:25:04 user nova-compute[75051]:       <mac address="fa:16:3e:bf:4f:d7"/>
Nov 24 19:25:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:25:04 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:25:04 user nova-compute[75051]:       <target dev="tap03178b6b-65"/>
Nov 24 19:25:04 user nova-compute[75051]:     </interface>
Nov 24 19:25:04 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:25:04 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/console.log" append="off"/>
Nov 24 19:25:04 user nova-compute[75051]:     </serial>
Nov 24 19:25:04 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:25:04 user nova-compute[75051]:     <video>
Nov 24 19:25:04 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:25:04 user nova-compute[75051]:     </video>
Nov 24 19:25:04 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:25:04 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:25:04 user nova-compute[75051]:     </rng>
Nov 24 19:25:04 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:25:04 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:25:04 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:25:04 user nova-compute[75051]:     </memballoon>
Nov 24 19:25:04 user nova-compute[75051]:   </devices>
Nov 24 19:25:04 user nova-compute[75051]: </domain>
Nov 24 19:25:04 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='55a0cb02-ae0b-4468-b17e-febac02ad14f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1496395464',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member',shelved_at='2023-11-24T19:23:08.308652',shelved_host='user',shelved_image_id='55a0cb02-ae0b-4468-b17e-febac02ad14f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:24:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG os_vif [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c9667c1-0ba8-55ab-b03b-eeff2c4880e5', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03178b6b-65, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03178b6b-65, col_values=(('qos', UUID('3978d9bb-70af-44a6-b8e9-4542341a45ea')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03178b6b-65, col_values=(('external_ids', {'iface-id': '03178b6b-652c-4257-b50b-d8ceb6efa63c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:4f:d7', 'vm-uuid': 'fbd33518-daa7-4be8-bd55-89f457eff75b'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:04 user nova-compute[75051]: INFO os_vif [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65')
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:25:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] No VIF found with MAC fa:16:3e:bf:4f:d7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:05 user nova-compute[75051]: WARNING nova.compute.manager [req-9a319303-1a89-4bdd-b4de-759cc78f6dd3 req-f4844c5f-5198-48bd-aba6-eb716c1aaa68 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 19:25:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:07 user nova-compute[75051]: WARNING nova.compute.manager [req-1e8edee7-ec35-47f3-a6fc-063544dc4a00 req-996ba3df-12ef-4122-ae67-190d79d5de67 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 24 19:25:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:25:08 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:25:08 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance spawned successfully.
Nov 24 19:25:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:25:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c54a68a6-2405-413c-a129-50b33522230d tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.449s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:25:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:25:21 user nova-compute[75051]: INFO nova.compute.claims [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Claim successful on node user
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:25:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.policy [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37067adbbf3746ccb3aa3ad60b617217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b6b1989d844cd49bb0a70f2d52e309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:25:21 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Creating image(s)
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:21 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.221s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Successfully created port: 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk 1073741824" returned: 0 in 0.060s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Cannot resize image /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Ensure instance console log exists: /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Successfully updated port: 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing instance network info cache due to event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance network_info: |[{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start _get_guest_xml network_info=[{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:25:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:23 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-541612196',display_name='tempest-ServerRescueNegativeTestJSON-server-541612196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-541612196',id=42,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdX8CWmzI2X4rnTympT1gQ0O1AU32mC5vzcp562rmWd7yJGOR+ImbsdKj+W+Tf6FmublYFzaTR2hnkb7dKaSDRZSRFX0IlAptkC4faHC2GR15pUI7IlLCZ95Oya6jF4Qg==',key_name='tempest-keypair-342125342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-04efiojo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=a4acefaf-0d61-420b-998d-2c020099a21d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:25:23 user nova-compute[75051]:   <uuid>a4acefaf-0d61-420b-998d-2c020099a21d</uuid>
Nov 24 19:25:23 user nova-compute[75051]:   <name>instance-0000002a</name>
Nov 24 19:25:23 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:25:23 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:25:23 user nova-compute[75051]:   <metadata>
Nov 24 19:25:23 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:25:23 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-541612196</nova:name>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:25:23</nova:creationTime>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:25:23 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:25:23 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:owner>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:25:23 user nova-compute[75051]:       </nova:owner>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:25:23 user nova-compute[75051]:       <nova:ports>
Nov 24 19:25:23 user nova-compute[75051]:         <nova:port uuid="7075715a-6e45-48f0-b2a8-0f00ea21b877">
Nov 24 19:25:23 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:25:23 user nova-compute[75051]:         </nova:port>
Nov 24 19:25:23 user nova-compute[75051]:       </nova:ports>
Nov 24 19:25:23 user nova-compute[75051]:     </nova:instance>
Nov 24 19:25:23 user nova-compute[75051]:   </metadata>
Nov 24 19:25:23 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:25:23 user nova-compute[75051]:     <system>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="serial">a4acefaf-0d61-420b-998d-2c020099a21d</entry>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="uuid">a4acefaf-0d61-420b-998d-2c020099a21d</entry>
Nov 24 19:25:23 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:25:23 user nova-compute[75051]:     </system>
Nov 24 19:25:23 user nova-compute[75051]:   </sysinfo>
Nov 24 19:25:23 user nova-compute[75051]:   <os>
Nov 24 19:25:23 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:25:23 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:25:23 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:25:23 user nova-compute[75051]:   </os>
Nov 24 19:25:23 user nova-compute[75051]:   <features>
Nov 24 19:25:23 user nova-compute[75051]:     <acpi/>
Nov 24 19:25:23 user nova-compute[75051]:     <apic/>
Nov 24 19:25:23 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:25:23 user nova-compute[75051]:   </features>
Nov 24 19:25:23 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:25:23 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:25:23 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:25:23 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:25:23 user nova-compute[75051]:   </clock>
Nov 24 19:25:23 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:25:23 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:25:23 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:25:23 user nova-compute[75051]:   </cpu>
Nov 24 19:25:23 user nova-compute[75051]:   <devices>
Nov 24 19:25:23 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:25:23 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:25:23 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk"/>
Nov 24 19:25:23 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:25:23 user nova-compute[75051]:     </disk>
Nov 24 19:25:23 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:25:23 user nova-compute[75051]:       <mac address="fa:16:3e:cd:c4:15"/>
Nov 24 19:25:23 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:25:23 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:25:23 user nova-compute[75051]:       <target dev="tap7075715a-6e"/>
Nov 24 19:25:23 user nova-compute[75051]:     </interface>
Nov 24 19:25:23 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:25:23 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/console.log" append="off"/>
Nov 24 19:25:23 user nova-compute[75051]:     </serial>
Nov 24 19:25:23 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:25:23 user nova-compute[75051]:     <video>
Nov 24 19:25:23 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:25:23 user nova-compute[75051]:     </video>
Nov 24 19:25:23 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:25:23 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:25:23 user nova-compute[75051]:     </rng>
Nov 24 19:25:23 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:25:23 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:25:23 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:25:23 user nova-compute[75051]:     </memballoon>
Nov 24 19:25:23 user nova-compute[75051]:   </devices>
Nov 24 19:25:23 user nova-compute[75051]: </domain>
Nov 24 19:25:23 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-541612196',display_name='tempest-ServerRescueNegativeTestJSON-server-541612196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-541612196',id=42,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdX8CWmzI2X4rnTympT1gQ0O1AU32mC5vzcp562rmWd7yJGOR+ImbsdKj+W+Tf6FmublYFzaTR2hnkb7dKaSDRZSRFX0IlAptkC4faHC2GR15pUI7IlLCZ95Oya6jF4Qg==',key_name='tempest-keypair-342125342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-04efiojo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:25:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=a4acefaf-0d61-420b-998d-2c020099a21d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG os_vif [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '887a4490-b9ab-55b2-8711-850d415a11a9', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7075715a-6e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7075715a-6e, col_values=(('qos', UUID('09c12d6a-903d-47bb-80cc-0c11ffcb41d6')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7075715a-6e, col_values=(('external_ids', {'iface-id': '7075715a-6e45-48f0-b2a8-0f00ea21b877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:c4:15', 'vm-uuid': 'a4acefaf-0d61-420b-998d-2c020099a21d'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:23 user nova-compute[75051]: INFO os_vif [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e')
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:cd:c4:15, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated VIF entry in instance network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-45d82dff-76cd-4fe8-8336-c8837373857f req-1c24a0e3-7de3-4c44-995d-9445675789fc service nova] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:25:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:25 user nova-compute[75051]: DEBUG nova.compute.manager [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:25 user nova-compute[75051]: WARNING nova.compute.manager [req-6a505584-1868-4b1e-9d73-229c273caf16 req-dd312874-083a-44e6-8d94-3aa58188f157 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state building and task_state spawning.
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.compute.manager [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:27 user nova-compute[75051]: WARNING nova.compute.manager [req-974570a0-1b56-4078-b2bc-bdbf0bf03f02 req-47241660-7862-4194-9515-e41b31c3fe1d service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state building and task_state spawning.
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:25:27 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance spawned successfully.
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:25:27 user nova-compute[75051]: INFO nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:25:27 user nova-compute[75051]: INFO nova.compute.manager [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Took 6.53 seconds to build instance.
Nov 24 19:25:27 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f36b0b14-7b22-4b98-8b01-39ec8c282aac tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:27 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:25:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.319s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:25:33 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:33 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8515MB free_disk=25.127239227294922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 0bfc95c1-5653-48ea-9376-ece538a06899 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fbd33518-daa7-4be8-bd55-89f457eff75b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:25:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-changed-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Refreshing instance network info cache due to event network-changed-8da2eb31-7078-49b7-b47a-218ede0098f3. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] Acquiring lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] Acquired lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Refreshing network info cache for port 8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:47 user nova-compute[75051]: INFO nova.compute.manager [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Terminating instance
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updated VIF entry in instance network info cache for port 8da2eb31-7078-49b7-b47a-218ede0098f3. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updating instance_info_cache with network_info: [{"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0ab44802-6ffb-489c-b429-fcd8b7b91bc9 req-2158b69a-6d66-4b1f-a28c-c3be6804001e service nova] Releasing lock "refresh_cache-0bfc95c1-5653-48ea-9376-ece538a06899" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Instance destroyed successfully.
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'resources' on Instance uuid 0bfc95c1-5653-48ea-9376-ece538a06899 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-390775376',display_name='tempest-AttachVolumeNegativeTest-server-390775376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-390775376',id=41,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUiboSvm3wCzMAcmpH3kSM8Cf0UOZxWfTa5OADkMfzIku5fmck08O3fnPy1REcQYAdUaLGmAu3owucQeqH6cC/sJPHtT6zMZ7Ef9H1USms6uOyVvMW4P1ehdDUBg1DbIQ==',key_name='tempest-keypair-757706689',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-i0y7z0nx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:24:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=0bfc95c1-5653-48ea-9376-ece538a06899,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8da2eb31-7078-49b7-b47a-218ede0098f3", "address": "fa:16:3e:ea:e9:b0", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8da2eb31-70", "ovs_interfaceid": "8da2eb31-7078-49b7-b47a-218ede0098f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG os_vif [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8da2eb31-70, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6675d45-a8e3-4009-b4d8-7a0f170ffb58) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:25:48 user nova-compute[75051]: INFO os_vif [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:b0,bridge_name='br-int',has_traffic_filtering=True,id=8da2eb31-7078-49b7-b47a-218ede0098f3,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8da2eb31-70')
Nov 24 19:25:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Deleting instance files /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899_del
Nov 24 19:25:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Deletion of /opt/stack/data/nova/instances/0bfc95c1-5653-48ea-9376-ece538a06899_del complete
Nov 24 19:25:48 user nova-compute[75051]: INFO nova.compute.manager [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 24 19:25:48 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:49 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Took 0.69 seconds to deallocate network for instance.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-baa5a606-8e72-4bee-b5d6-9a514186a3a1 req-e9f750dd-fdba-4dea-91db-cfe6c27d1725 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-deleted-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: INFO nova.compute.manager [req-baa5a606-8e72-4bee-b5d6-9a514186a3a1 req-e9f750dd-fdba-4dea-91db-cfe6c27d1725 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Neutron deleted interface 8da2eb31-7078-49b7-b47a-218ede0098f3; detaching it from the instance and deleting it from the info cache
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.network.neutron [req-baa5a606-8e72-4bee-b5d6-9a514186a3a1 req-e9f750dd-fdba-4dea-91db-cfe6c27d1725 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-baa5a606-8e72-4bee-b5d6-9a514186a3a1 req-e9f750dd-fdba-4dea-91db-cfe6c27d1725 service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Detach interface failed, port_id=8da2eb31-7078-49b7-b47a-218ede0098f3, reason: Instance 0bfc95c1-5653-48ea-9376-ece538a06899 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-unplugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Acquiring lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] Lock "0bfc95c1-5653-48ea-9376-ece538a06899-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] No waiting events found dispatching network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:25:49 user nova-compute[75051]: WARNING nova.compute.manager [req-1dfcb374-7f7d-43c2-8378-68b58af2f78a req-ad5a892a-248a-443e-82c9-6f97c611c47d service nova] [instance: 0bfc95c1-5653-48ea-9376-ece538a06899] Received unexpected event network-vif-plugged-8da2eb31-7078-49b7-b47a-218ede0098f3 for instance with vm_state deleted and task_state None.
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:49 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Deleted allocations for instance 0bfc95c1-5653-48ea-9376-ece538a06899
Nov 24 19:25:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-4e0fc118-42aa-4dd2-9f1d-3efa7a588d05 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "0bfc95c1-5653-48ea-9376-ece538a06899" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:25:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:25:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:26:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:29 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:26:31 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:26:32 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.12628173828125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance fbd33518-daa7-4be8-bd55-89f457eff75b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:26:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:38 user nova-compute[75051]: INFO nova.compute.manager [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Detaching volume 420a58d1-e044-41d4-8fee-573b2c0d02d1
Nov 24 19:26:38 user nova-compute[75051]: INFO nova.virt.block_device [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Attempting to driver detach volume 420a58d1-e044-41d4-8fee-573b2c0d02d1 from mountpoint /dev/vdb
Nov 24 19:26:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Attempting to detach device vdb from instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:26:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:26:38 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:26:38 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:26:38 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:26:38 user nova-compute[75051]:   <serial>420a58d1-e044-41d4-8fee-573b2c0d02d1</serial>
Nov 24 19:26:38 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:26:38 user nova-compute[75051]: </disk>
Nov 24 19:26:38 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:26:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 from the persistent domain config.
Nov 24 19:26:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:26:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:26:38 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:26:38 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:26:38 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:26:38 user nova-compute[75051]:   <serial>420a58d1-e044-41d4-8fee-573b2c0d02d1</serial>
Nov 24 19:26:38 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:26:38 user nova-compute[75051]: </disk>
Nov 24 19:26:38 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:26:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:26:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:26:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:47 user nova-compute[75051]: INFO nova.compute.manager [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Terminating instance
Nov 24 19:26:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-ada61d10-0409-437d-8ac7-a5930dcc566a req-2070069f-ad97-44ef-a752-2268f85ebfc4 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-unplugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:26:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Instance destroyed successfully.
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lazy-loading 'resources' on Instance uuid fbd33518-daa7-4be8-bd55-89f457eff75b {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-24T19:21:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1166797930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1166797930',id=39,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4cr6rg+r6Pe7I4MJi9VKZq/gi2qB73DlVlEmCvQcomaO3Zus923DoJZEJx8uhdnXfC2U4Mh+500hWYY2xvRF5kCrB9Mj9Z0K+4UC8OLAkXw3BxXjxP1USfhzEslZ8aiA==',key_name='tempest-keypair-1496395464',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:25:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cc3182a5d4540cfab6a2a919f79f3b9',ramdisk_id='',reservation_id='r-iy3yblq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1174395931',owner_user_name='tempest-AttachVolumeShelveTestJSON-1174395931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:25:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b2c20e8819f346e8b5c57a77becb0c68',uuid=fbd33518-daa7-4be8-bd55-89f457eff75b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converting VIF {"id": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "address": "fa:16:3e:bf:4f:d7", "network": {"id": "cf8e558b-5b7e-4483-8027-e30bbb071e75", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-146819164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cc3182a5d4540cfab6a2a919f79f3b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03178b6b-65", "ovs_interfaceid": "03178b6b-652c-4257-b50b-d8ceb6efa63c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG os_vif [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03178b6b-65, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3978d9bb-70af-44a6-b8e9-4542341a45ea) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:48 user nova-compute[75051]: INFO os_vif [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:4f:d7,bridge_name='br-int',has_traffic_filtering=True,id=03178b6b-652c-4257-b50b-d8ceb6efa63c,network=Network(cf8e558b-5b7e-4483-8027-e30bbb071e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03178b6b-65')
Nov 24 19:26:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Deleting instance files /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b_del
Nov 24 19:26:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Deletion of /opt/stack/data/nova/instances/fbd33518-daa7-4be8-bd55-89f457eff75b_del complete
Nov 24 19:26:48 user nova-compute[75051]: INFO nova.compute.manager [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 24 19:26:48 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:26:48 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:26:49 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Took 0.93 seconds to deallocate network for instance.
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:49 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Deleted allocations for instance fbd33518-daa7-4be8-bd55-89f457eff75b
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-493a94fd-4210-47a3-a9d1-bb3b671ed1b9 tempest-AttachVolumeShelveTestJSON-1174395931 tempest-AttachVolumeShelveTestJSON-1174395931-project-member] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] Acquiring lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] Lock "fbd33518-daa7-4be8-bd55-89f457eff75b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] No waiting events found dispatching network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:26:49 user nova-compute[75051]: WARNING nova.compute.manager [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received unexpected event network-vif-plugged-03178b6b-652c-4257-b50b-d8ceb6efa63c for instance with vm_state deleted and task_state None.
Nov 24 19:26:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-48edbe7a-d6ed-4a44-a3a6-480044c3ad27 req-ed4dad41-bd99-4cd5-9699-72107d21ce26 service nova] [instance: fbd33518-daa7-4be8-bd55-89f457eff75b] Received event network-vif-deleted-03178b6b-652c-4257-b50b-d8ceb6efa63c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:26:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:26:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 is timed out.
Nov 24 19:26:59 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance e54115c0-091c-4889-91eb-fb7a0a97e9c3 from the live domain config.
Nov 24 19:26:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdEsHDTi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:26:59 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acac240-d514-4786-942a-46bc3d932744]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:26:59 user nova-compute[75051]: No targets found.
Nov 24 19:26:59 user nova-compute[75051]: iSNS:
Nov 24 19:26:59 user nova-compute[75051]: No targets found.
Nov 24 19:26:59 user nova-compute[75051]: STATIC:
Nov 24 19:26:59 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1
Nov 24 19:26:59 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:26:59 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:26:59 user nova-compute[75051]: FIRMWARE:
Nov 24 19:26:59 user nova-compute[75051]: No targets found.
Nov 24 19:26:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:26:59 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:26:59 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc265f3a-041e-4f7b-b8af-7869ab8ec8c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[985f6288-fa5a-4621-8b83-da624f024ce7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)
Nov 24 19:26:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 (non-flash)
Nov 24 19:26:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b8205750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb73cea0-236d-4b6a-8a3a-d1405dbdc003]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fc534-dd93-4a5c-92d8-f0be0c86a478]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6076ef-bc60-4897-8726-f1d495fba323]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[786de37e-2ad8-448d-8e24-695c22d6cffa]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf64657-8637-481c-8a90-ed5013d17573]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4651d-3ef2-4cb8-8b30-287e53ad3499]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260]
Nov 24 19:26:59 user nova-compute[75051]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1, portal: 172.16.0.220,3260] successful.
Nov 24 19:26:59 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:420a58d1-e044-41d4-8fee-573b2c0d02d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7cf93-a2dd-417a-bd02-e252afa748ec]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== disconnect_volume: return (275ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:26:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:27:00 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883c799f-987c-49cc-9c35-d1f72456fde0 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.840s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:27:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing instance network info cache due to event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:27:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:27:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:27:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'flavor' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated VIF entry in instance network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:12 user nova-compute[75051]: INFO nova.compute.manager [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Attaching volume cabac2a0-4a86-4873-913d-4fe30487685b to /dev/vdb
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1233a5c7-ead7-4efa-982f-6ab5aceb1d88 req-d82136dd-79f9-46d3-9d5a-15d0dd48f8ce service nova] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.utils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd084a8-4fcc-46af-a629-ec3608af673d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ed2904-415a-47bf-a4b3-9faf0c67d764]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf309f-349b-459b-a9b5-79b9baf4ec56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8a568d-2925-4a70-853a-1449ca059c33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:27:12 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:27:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1344ca-23a7-4431-a895-74c1f16a4856]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG os_brick.utils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating existing volume attachment record: b9c51144-ca93-495e-8590-450799c09709 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:27:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTkcFeVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:27:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:27:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:27:18 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9478bf-90d2-4530-840a-ac02b9f46340]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:27:18 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f23bfdf-a9d5-4889-88d5-4fc157a6cd8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b] added
Nov 24 19:27:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc218708-54bf-43bd-95ef-27940b14f7ce]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[056efb71-8ca5-4ea7-a824-7d7884ea1a00]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTkcFeVL {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CTkcFeVL" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2963800-9976-43b4-8da4-3171bde5649a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CTkcFeVL'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e7bf4-cf27-4153-9904-c1c33eea6c69]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ff155b-a2ea-4311-8367-0f62a443693c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:27:18 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:27:18 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:27:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:27:18 user nova-compute[75051]: 
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d1a9b-3de0-4da6-8e41-f979ea869c49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260]
Nov 24 19:27:18 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260] successful.
Nov 24 19:27:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6760c0e-1aa3-4086-aba8-1f784a68aafd]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fc371-75b8-4314-bde2-99e524360968]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:27:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:27:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91a2730-5eec-4c0e-8191-8032de3732f3]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:27:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTkcFeVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:27:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:27:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23730323638383639', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:27:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730323638383639', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:27:19 user nova-compute[75051]: DEBUG nova.objects.instance [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'flavor' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:27:19 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:27:19 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:27:19 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:27:19 user nova-compute[75051]:   <serial>cabac2a0-4a86-4873-913d-4fe30487685b</serial>
Nov 24 19:27:19 user nova-compute[75051]: </disk>
Nov 24 19:27:19 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:27:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:27:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:27:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:cd:c4:15, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:27:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-85d0bb95-26b7-49b8-89e5-5d085ef463fd tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.875s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:21 user nova-compute[75051]: INFO nova.compute.manager [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Rescuing
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG nova.network.neutron [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:21 user nova-compute[75051]: DEBUG nova.compute.manager [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:21 user nova-compute[75051]: WARNING nova.compute.manager [req-9fdc77c5-a5f2-4497-8127-9d2caadbfbea req-6042cc08-365e-4668-88df-5200a2516795 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state active and task_state rescuing.
Nov 24 19:27:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance destroyed successfully.
Nov 24 19:27:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Attempting rescue
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75051) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance directory exists: not creating {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 24 19:27:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Creating image(s)
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'trusted_certs' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue" returned: 0 in 0.048s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'migration_context' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.base [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<a4acefaf-0d61-420b-998d-2c020099a21d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start _get_guest_xml network_info=[{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:cd:c4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.base [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<a4acefaf-0d61-420b-998d-2c020099a21d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'numa_topology' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.base [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<a4acefaf-0d61-420b-998d-2c020099a21d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:27:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:27:22 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'vcpu_model' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.base [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<a4acefaf-0d61-420b-998d-2c020099a21d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-541612196',display_name='tempest-ServerRescueNegativeTestJSON-server-541612196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-541612196',id=42,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdX8CWmzI2X4rnTympT1gQ0O1AU32mC5vzcp562rmWd7yJGOR+ImbsdKj+W+Tf6FmublYFzaTR2hnkb7dKaSDRZSRFX0IlAptkC4faHC2GR15pUI7IlLCZ95Oya6jF4Qg==',key_name='tempest-keypair-342125342',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:25:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-04efiojo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:25:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=a4acefaf-0d61-420b-998d-2c020099a21d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:cd:c4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "vif_mac": "fa:16:3e:cd:c4:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.instance [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'pci_devices' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.objects.base [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Object Instance<a4acefaf-0d61-420b-998d-2c020099a21d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75051) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:27:22 user nova-compute[75051]:   <uuid>a4acefaf-0d61-420b-998d-2c020099a21d</uuid>
Nov 24 19:27:22 user nova-compute[75051]:   <name>instance-0000002a</name>
Nov 24 19:27:22 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:27:22 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:27:22 user nova-compute[75051]:   <metadata>
Nov 24 19:27:22 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:27:22 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-541612196</nova:name>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:27:22</nova:creationTime>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:27:22 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:27:22 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:owner>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:user uuid="37067adbbf3746ccb3aa3ad60b617217">tempest-ServerRescueNegativeTestJSON-972671946-project-member</nova:user>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:project uuid="57b6b1989d844cd49bb0a70f2d52e309">tempest-ServerRescueNegativeTestJSON-972671946</nova:project>
Nov 24 19:27:22 user nova-compute[75051]:       </nova:owner>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:27:22 user nova-compute[75051]:       <nova:ports>
Nov 24 19:27:22 user nova-compute[75051]:         <nova:port uuid="7075715a-6e45-48f0-b2a8-0f00ea21b877">
Nov 24 19:27:22 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:27:22 user nova-compute[75051]:         </nova:port>
Nov 24 19:27:22 user nova-compute[75051]:       </nova:ports>
Nov 24 19:27:22 user nova-compute[75051]:     </nova:instance>
Nov 24 19:27:22 user nova-compute[75051]:   </metadata>
Nov 24 19:27:22 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:27:22 user nova-compute[75051]:     <system>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="serial">a4acefaf-0d61-420b-998d-2c020099a21d</entry>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="uuid">a4acefaf-0d61-420b-998d-2c020099a21d</entry>
Nov 24 19:27:22 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:27:22 user nova-compute[75051]:     </system>
Nov 24 19:27:22 user nova-compute[75051]:   </sysinfo>
Nov 24 19:27:22 user nova-compute[75051]:   <os>
Nov 24 19:27:22 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:27:22 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:27:22 user nova-compute[75051]:   </os>
Nov 24 19:27:22 user nova-compute[75051]:   <features>
Nov 24 19:27:22 user nova-compute[75051]:     <acpi/>
Nov 24 19:27:22 user nova-compute[75051]:     <apic/>
Nov 24 19:27:22 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:27:22 user nova-compute[75051]:   </features>
Nov 24 19:27:22 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:27:22 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:27:22 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:27:22 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:27:22 user nova-compute[75051]:   </clock>
Nov 24 19:27:22 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:27:22 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:27:22 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:27:22 user nova-compute[75051]:   </cpu>
Nov 24 19:27:22 user nova-compute[75051]:   <devices>
Nov 24 19:27:22 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:27:22 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:27:22 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue"/>
Nov 24 19:27:22 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:27:22 user nova-compute[75051]:     </disk>
Nov 24 19:27:22 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:27:22 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:27:22 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk"/>
Nov 24 19:27:22 user nova-compute[75051]:       <target dev="vdb" bus="virtio"/>
Nov 24 19:27:22 user nova-compute[75051]:     </disk>
Nov 24 19:27:22 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:27:22 user nova-compute[75051]:       <mac address="fa:16:3e:cd:c4:15"/>
Nov 24 19:27:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:27:22 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:27:22 user nova-compute[75051]:       <target dev="tap7075715a-6e"/>
Nov 24 19:27:22 user nova-compute[75051]:     </interface>
Nov 24 19:27:22 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:27:22 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/console.log" append="off"/>
Nov 24 19:27:22 user nova-compute[75051]:     </serial>
Nov 24 19:27:22 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:27:22 user nova-compute[75051]:     <video>
Nov 24 19:27:22 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:27:22 user nova-compute[75051]:     </video>
Nov 24 19:27:22 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:27:22 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:27:22 user nova-compute[75051]:     </rng>
Nov 24 19:27:22 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:27:22 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:27:22 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:27:22 user nova-compute[75051]:     </memballoon>
Nov 24 19:27:22 user nova-compute[75051]:   </devices>
Nov 24 19:27:22 user nova-compute[75051]: </domain>
Nov 24 19:27:22 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:27:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance destroyed successfully.
Nov 24 19:27:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:27:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] No VIF found with MAC fa:16:3e:cd:c4:15, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:27:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:24 user nova-compute[75051]: WARNING nova.compute.manager [req-b8cf415b-0f50-494e-b3ea-ac1e32e671f2 req-7def537c-8507-44fc-b24c-38b826b831dd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state active and task_state rescuing.
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:26 user nova-compute[75051]: WARNING nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state active and task_state rescuing.
Nov 24 19:27:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:26 user nova-compute[75051]: WARNING nova.compute.manager [req-dd41505e-4d83-44cf-b8fc-51affc600bc4 req-0ba7facc-83e8-42d3-b54a-5f0e78ea526c service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state active and task_state rescuing.
Nov 24 19:27:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-883d9bdd-fdc4-4e33-9ef6-b46ccc04b9c1 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:27:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:28 user nova-compute[75051]: INFO nova.compute.manager [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Terminating instance
Nov 24 19:27:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-7614576d-0f25-47a0-bc12-d5d788b2d98c req-7c16a977-01f3-4823-aa5e-dc62d4365069 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Instance destroyed successfully.
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.objects.instance [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'resources' on Instance uuid e54115c0-091c-4889-91eb-fb7a0a97e9c3 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:21:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-304362412',display_name='tempest-AttachVolumeNegativeTest-server-304362412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-304362412',id=40,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Wa77hQHmrT5+zTIU2wKFMZLkID0QrCmsfc5rimkEWBxeQzDyE6c9b8bhRVv9bAe62OcgEWTlet1Rz/PkioNNIYEfHeQTiOk//OQfrh+44Urb/oFeYSGPxMTTgIRtcyw==',key_name='tempest-keypair-178512177',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:21:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-56qruixo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:21:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=e54115c0-091c-4889-91eb-fb7a0a97e9c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "8eec7d63-224e-48a2-9569-2528c186a51c", "address": "fa:16:3e:fb:fc:55", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eec7d63-22", "ovs_interfaceid": "8eec7d63-224e-48a2-9569-2528c186a51c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG os_vif [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eec7d63-22, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd3bee8e-3e07-4e6c-bd36-867f148db60c) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:29 user nova-compute[75051]: INFO os_vif [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=8eec7d63-224e-48a2-9569-2528c186a51c,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eec7d63-22')
Nov 24 19:27:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Deleting instance files /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3_del
Nov 24 19:27:29 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Deletion of /opt/stack/data/nova/instances/e54115c0-091c-4889-91eb-fb7a0a97e9c3_del complete
Nov 24 19:27:29 user nova-compute[75051]: INFO nova.compute.manager [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 24 19:27:29 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:31 user nova-compute[75051]: WARNING nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state active and task_state deleting.
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:31 user nova-compute[75051]: WARNING nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state active and task_state deleting.
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:31 user nova-compute[75051]: WARNING nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state active and task_state deleting.
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-7478660d-bda6-4f2f-bbdc-c8ef29163a29 req-f303d9a6-f029-4aec-b891-7142bbc60f57 service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-unplugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:27:31 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Took 1.71 seconds to deallocate network for instance.
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:31 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:27:31 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Deleted allocations for instance e54115c0-091c-4889-91eb-fb7a0a97e9c3
Nov 24 19:27:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-70cb596d-4d2f-43d1-bfba-12be9d4775ec tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] Acquiring lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] Lock "e54115c0-091c-4889-91eb-fb7a0a97e9c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] No waiting events found dispatching network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:27:33 user nova-compute[75051]: WARNING nova.compute.manager [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received unexpected event network-vif-plugged-8eec7d63-224e-48a2-9569-2528c186a51c for instance with vm_state deleted and task_state None.
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-10758912-f0cd-45a0-bc1e-5c54dc60e074 req-cab9101c-5398-44a9-8461-3ab29041136d service nova] [instance: e54115c0-091c-4889-91eb-fb7a0a97e9c3] Received event network-vif-deleted-8eec7d63-224e-48a2-9569-2528c186a51c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:27:33 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:27:33 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.16431427001953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:27:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:27:34 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:27:34 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:27:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:27:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:27:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:27:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:27:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Verify base images {{(pid=75051) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Image id 5493a48f-5fd1-4417-ad27-dfb869ec17c2 yields fingerprint e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 {{(pid=75051) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 24 19:28:00 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] image 5493a48f-5fd1-4417-ad27-dfb869ec17c2 at (/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451): checking
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] image 5493a48f-5fd1-4417-ad27-dfb869ec17c2 at (/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451): image is in use {{(pid=75051) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75051) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] c314a125-ae40-4829-af87-09288fd1d85a is a valid instance name {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] c314a125-ae40-4829-af87-09288fd1d85a has a disk file {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 19:28:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a is backed by e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] a4acefaf-0d61-420b-998d-2c020099a21d is a valid instance name {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] a4acefaf-0d61-420b-998d-2c020099a21d has a disk file {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d is backed by e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] 7efb1743-512a-4bda-9930-b03c160b98f6 is a valid instance name {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] 7efb1743-512a-4bda-9930-b03c160b98f6 has a disk file {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 is backed by e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 {{(pid=75051) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05
Nov 24 19:28:01 user nova-compute[75051]: WARNING nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Active base files: /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Removable base files: /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300 /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4 /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016 /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427 /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94 /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6 /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05 /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9629ebfc2076cb7b871dc9a453cbe85a80419fcd
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/036fe78e26ce14bd357fc5ae2471d7199f482300
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1e8774bbadc3ff1634c173d64a83e5648c0b76b4
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad15fdf451a7a1525a1fd1a2395e7b6106ac6016
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/195c0fe9df4d997d3d36d61f66e088636ddf9427
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8835f0e62c04e438c16d8815ae97a5d50df0d94
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cfa47b07ef6c66f67237e3e93e5ce52ea07668e6
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/44da7ddaafc480eaeda07a40156fd83c5e249b05
Nov 24 19:28:01 user nova-compute[75051]: INFO nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ac45e371533afd3a1043356991edbe88601eb810
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Verification complete {{(pid=75051) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Verify swap images {{(pid=75051) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 24 19:28:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.imagecache [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Verify ephemeral images {{(pid=75051) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:28:23 user nova-compute[75051]: INFO nova.compute.claims [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Claim successful on node user
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:28:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.policy [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '918f479d20f449848b5b088b6aaf64d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c244443230f42adbf13dbcb8405247e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:28:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Creating image(s)
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk 1073741824" returned: 0 in 0.055s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Successfully created port: 43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Cannot resize image /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Ensure instance console log exists: /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Successfully updated port: 43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquired lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-changed-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.compute.manager [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Refreshing instance network info cache due to event network-changed-43bbc048-b97c-4d55-b96f-d2d8afc348bb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] Acquiring lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.neutron [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating instance_info_cache with network_info: [{"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Releasing lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Instance network_info: |[{"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] Acquired lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Refreshing network info cache for port 43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Start _get_guest_xml network_info=[{"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:28:25 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:28:25 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247924935',display_name='tempest-AttachVolumeNegativeTest-server-1247924935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247924935',id=43,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9ydLiOYKDz2nw3Rp5Zq9nI1dUdOQj+idSw1s/tzH1y9JpQ0V6MWTVlKEEQWNQHfTq8Np5Ue9TS1dCL4eP6U+QpPgUSdAPLMZQcrETX/cwNfLU9pld7W5pLa9RFyz6FbQ==',key_name='tempest-keypair-628313693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-x8dctsw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=1ee5f10e-dd2f-4b43-b51f-bc8570a8d387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.objects.instance [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:28:25 user nova-compute[75051]:   <uuid>1ee5f10e-dd2f-4b43-b51f-bc8570a8d387</uuid>
Nov 24 19:28:25 user nova-compute[75051]:   <name>instance-0000002b</name>
Nov 24 19:28:25 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:28:25 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:28:25 user nova-compute[75051]:   <metadata>
Nov 24 19:28:25 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:28:25 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1247924935</nova:name>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:28:25</nova:creationTime>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:28:25 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:28:25 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:owner>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:user uuid="918f479d20f449848b5b088b6aaf64d7">tempest-AttachVolumeNegativeTest-1689022931-project-member</nova:user>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:project uuid="0c244443230f42adbf13dbcb8405247e">tempest-AttachVolumeNegativeTest-1689022931</nova:project>
Nov 24 19:28:25 user nova-compute[75051]:       </nova:owner>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:28:25 user nova-compute[75051]:       <nova:ports>
Nov 24 19:28:25 user nova-compute[75051]:         <nova:port uuid="43bbc048-b97c-4d55-b96f-d2d8afc348bb">
Nov 24 19:28:25 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:28:25 user nova-compute[75051]:         </nova:port>
Nov 24 19:28:25 user nova-compute[75051]:       </nova:ports>
Nov 24 19:28:25 user nova-compute[75051]:     </nova:instance>
Nov 24 19:28:25 user nova-compute[75051]:   </metadata>
Nov 24 19:28:25 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:28:25 user nova-compute[75051]:     <system>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="serial">1ee5f10e-dd2f-4b43-b51f-bc8570a8d387</entry>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="uuid">1ee5f10e-dd2f-4b43-b51f-bc8570a8d387</entry>
Nov 24 19:28:25 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:28:25 user nova-compute[75051]:     </system>
Nov 24 19:28:25 user nova-compute[75051]:   </sysinfo>
Nov 24 19:28:25 user nova-compute[75051]:   <os>
Nov 24 19:28:25 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:28:25 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:28:25 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:28:25 user nova-compute[75051]:   </os>
Nov 24 19:28:25 user nova-compute[75051]:   <features>
Nov 24 19:28:25 user nova-compute[75051]:     <acpi/>
Nov 24 19:28:25 user nova-compute[75051]:     <apic/>
Nov 24 19:28:25 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:28:25 user nova-compute[75051]:   </features>
Nov 24 19:28:25 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:28:25 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:28:25 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:28:25 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:28:25 user nova-compute[75051]:   </clock>
Nov 24 19:28:25 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:28:25 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:28:25 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:28:25 user nova-compute[75051]:   </cpu>
Nov 24 19:28:25 user nova-compute[75051]:   <devices>
Nov 24 19:28:25 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:28:25 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:28:25 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk"/>
Nov 24 19:28:25 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:28:25 user nova-compute[75051]:     </disk>
Nov 24 19:28:25 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:28:25 user nova-compute[75051]:       <mac address="fa:16:3e:e5:a9:19"/>
Nov 24 19:28:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:28:25 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:28:25 user nova-compute[75051]:       <target dev="tap43bbc048-b9"/>
Nov 24 19:28:25 user nova-compute[75051]:     </interface>
Nov 24 19:28:25 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:28:25 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/console.log" append="off"/>
Nov 24 19:28:25 user nova-compute[75051]:     </serial>
Nov 24 19:28:25 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:28:25 user nova-compute[75051]:     <video>
Nov 24 19:28:25 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:28:25 user nova-compute[75051]:     </video>
Nov 24 19:28:25 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:28:25 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:28:25 user nova-compute[75051]:     </rng>
Nov 24 19:28:25 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:28:25 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:28:25 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:28:25 user nova-compute[75051]:     </memballoon>
Nov 24 19:28:25 user nova-compute[75051]:   </devices>
Nov 24 19:28:25 user nova-compute[75051]: </domain>
Nov 24 19:28:25 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247924935',display_name='tempest-AttachVolumeNegativeTest-server-1247924935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247924935',id=43,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9ydLiOYKDz2nw3Rp5Zq9nI1dUdOQj+idSw1s/tzH1y9JpQ0V6MWTVlKEEQWNQHfTq8Np5Ue9TS1dCL4eP6U+QpPgUSdAPLMZQcrETX/cwNfLU9pld7W5pLa9RFyz6FbQ==',key_name='tempest-keypair-628313693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-x8dctsw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=1ee5f10e-dd2f-4b43-b51f-bc8570a8d387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG os_vif [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fb1c94d-eb9c-5e69-a1c6-ea294a6964a6', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43bbc048-b9, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43bbc048-b9, col_values=(('qos', UUID('6dcea1e3-47f4-407a-91e7-8989b306cfea')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43bbc048-b9, col_values=(('external_ids', {'iface-id': '43bbc048-b97c-4d55-b96f-d2d8afc348bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:a9:19', 'vm-uuid': '1ee5f10e-dd2f-4b43-b51f-bc8570a8d387'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:25 user nova-compute[75051]: INFO os_vif [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9')
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:e5:a9:19, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updated VIF entry in instance network info cache for port 43bbc048-b97c-4d55-b96f-d2d8afc348bb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG nova.network.neutron [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating instance_info_cache with network_info: [{"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:28:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7116d304-a081-4aa8-bd76-934faaddecf7 req-1fc92b0f-9500-4740-8d05-c35cb1b33e3f service nova] Releasing lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:26 user nova-compute[75051]: DEBUG nova.compute.manager [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] No waiting events found dispatching network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:28:26 user nova-compute[75051]: WARNING nova.compute.manager [req-4094b27d-ec70-4cf2-886a-ed631cf98951 req-18c4981b-693a-436d-95cc-6f063e83364a service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received unexpected event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb for instance with vm_state building and task_state spawning.
Nov 24 19:28:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:28:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Instance spawned successfully.
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:28:28 user nova-compute[75051]: INFO nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:28 user nova-compute[75051]: DEBUG nova.compute.manager [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] No waiting events found dispatching network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:28:28 user nova-compute[75051]: WARNING nova.compute.manager [req-200aa4b1-f002-4ff2-a1b9-6208a7671c4c req-65ae38e4-797e-4483-ac54-3c310f38a06c service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received unexpected event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb for instance with vm_state building and task_state spawning.
Nov 24 19:28:28 user nova-compute[75051]: INFO nova.compute.manager [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Took 5.86 seconds to build instance.
Nov 24 19:28:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-bd93cf72-9f84-46aa-b824-11a6a2142a39 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.953s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:31 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:28:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:28:34 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:28:34 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.152481079101562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:28:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:28:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:28:41 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:28:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:28:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:28:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:28:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:28:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:29:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:12 user nova-compute[75051]: INFO nova.compute.manager [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Unrescuing
Nov 24 19:29:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:29:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:29:12 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG nova.network.neutron [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'flavor' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:29:13 user nova-compute[75051]: WARNING nova.compute.manager [req-95d9ca99-a072-4054-be79-10fec827f942 req-2be9e5ef-15c1-4bdd-8119-c1e3dc32f986 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:29:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance destroyed successfully.
Nov 24 19:29:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:29:15 user nova-compute[75051]: WARNING nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:29:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:29:15 user nova-compute[75051]: WARNING nova.compute.manager [req-3a1bd2d7-5815-4c12-8776-0be53b9c946a req-7be52652-6316-409a-8d63-c860b44507cd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state rescued and task_state unrescuing.
Nov 24 19:29:17 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0b81401d-6924-40ec-815f-3b0929750e55 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:29:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:29:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:29:17 user nova-compute[75051]: WARNING nova.compute.manager [req-9e9aebaa-2a46-48e2-963e-2f608d4f0ab9 req-44d772bf-29cd-43cf-b521-4aa3f91c2a3a service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state active and task_state None.
Nov 24 19:29:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "c314a125-ae40-4829-af87-09288fd1d85a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "c314a125-ae40-4829-af87-09288fd1d85a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:29:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:29:32 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:32 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:29:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:29:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:29:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:29:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.12152099609375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:29:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:29:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:29:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [{"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-7efb1743-512a-4bda-9930-b03c160b98f6" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:49 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:29:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:29:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:30:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-changed-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:30:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Refreshing instance network info cache due to event network-changed-43bbc048-b97c-4d55-b96f-d2d8afc348bb. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:30:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] Acquiring lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:30:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] Acquired lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:30:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Refreshing network info cache for port 43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:30:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updated VIF entry in instance network info cache for port 43bbc048-b97c-4d55-b96f-d2d8afc348bb. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:30:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating instance_info_cache with network_info: [{"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:30:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-9414f289-1def-40b6-97f3-0b21cc983739 req-b9d9a3a4-e0ea-4551-83c4-46587cf843ce service nova] Releasing lock "refresh_cache-1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:30:16 user nova-compute[75051]: INFO nova.compute.manager [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Attaching volume 05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 to /dev/vdb
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.utils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb033ab-00a3-4564-a8a9-499578adcaee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff1584-daf7-4d67-9fe0-258b01b93433]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcdb100-6e2d-47b8-a455-88f5bbc58f66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ca2143-d381-4d50-98cd-ab3897b14d4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:30:16 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:30:16 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ac390-81bb-4235-b90b-bbe2dbf4b2cc]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG os_brick.utils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:30:16 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating existing volume attachment record: 2460d2d1-fca1-49d2-8ba8-8ee5e8c009d6 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:30:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DExrCsTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:30:22 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:30:22 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:30:22 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e7e88-2aa6-49c8-bbf7-230d806cd300]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:30:22 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a95e7-482b-4ab1-9d56-b18b2ef88416]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0] added
Nov 24 19:30:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b764b65-e133-4e09-b683-fc7d6931aeaf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9acbf-86fb-40c1-820b-f4314facaca8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DExrCsTn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DExrCsTn" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6dc9d1-7d7a-42b9-8ac9-d52fd6fbffcf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DExrCsTn'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503df4e-c0b7-44ee-baed-7f193baacb6c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a2d5d-31dd-457e-8e72-e511cbcb696e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8af713-1da5-4791-9061-50ba5912d1cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260]
Nov 24 19:30:22 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260] successful.
Nov 24 19:30:22 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c236744-a755-402b-aa35-856990b18cda]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ae43e-f98a-44b5-8b52-c8c208237af3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:23 user nova-compute[75051]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)
Nov 24 19:30:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:23 user nova-compute[75051]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)
Nov 24 19:30:23 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb99ff2c-df9b-4d81-bceb-379a63658bc2]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:30:23 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DExrCsTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23661326634313539', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661326634313539', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:30:24 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:30:24 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:30:24 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:30:24 user nova-compute[75051]:   <serial>05cfdfd2-8a11-40ca-89a1-cfc002c10bc0</serial>
Nov 24 19:30:24 user nova-compute[75051]: </disk>
Nov 24 19:30:24 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:e5:a9:19, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:30:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9f413bcf-7552-4652-8e02-930d2325217b tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.877s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:30:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:30:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:30:25 user nova-compute[75051]: INFO nova.compute.manager [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Detaching volume 05cfdfd2-8a11-40ca-89a1-cfc002c10bc0
Nov 24 19:30:25 user nova-compute[75051]: INFO nova.virt.block_device [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Attempting to driver detach volume 05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 from mountpoint /dev/vdb
Nov 24 19:30:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Attempting to detach device vdb from instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:30:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:30:25 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:30:25 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:30:25 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:30:25 user nova-compute[75051]:   <serial>05cfdfd2-8a11-40ca-89a1-cfc002c10bc0</serial>
Nov 24 19:30:25 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:30:25 user nova-compute[75051]: </disk>
Nov 24 19:30:25 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:30:25 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 from the persistent domain config.
Nov 24 19:30:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:30:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:30:25 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:30:25 user nova-compute[75051]:   <source dev="/dev/sdc"/>
Nov 24 19:30:25 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:30:25 user nova-compute[75051]:   <serial>05cfdfd2-8a11-40ca-89a1-cfc002c10bc0</serial>
Nov 24 19:30:25 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:30:25 user nova-compute[75051]: </disk>
Nov 24 19:30:25 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:30:26 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:30:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:30:33 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:35 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:30:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:30:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.119884490966797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:30:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:30:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:30:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:30:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:30:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:30:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [{"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:30:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c314a125-ae40-4829-af87-09288fd1d85a" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:30:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:30:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 is timed out.
Nov 24 19:30:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 from the live domain config.
Nov 24 19:30:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DExrCsTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:30:46 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ace7de-908d-4d40-8eb8-677bdb9e8256]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:30:46 user nova-compute[75051]: No targets found.
Nov 24 19:30:46 user nova-compute[75051]: iSNS:
Nov 24 19:30:46 user nova-compute[75051]: No targets found.
Nov 24 19:30:46 user nova-compute[75051]: STATIC:
Nov 24 19:30:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0
Nov 24 19:30:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:30:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:30:46 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b
Nov 24 19:30:46 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:30:46 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:30:46 user nova-compute[75051]: FIRMWARE:
Nov 24 19:30:46 user nova-compute[75051]: No targets found.
Nov 24 19:30:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:30:46 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:30:46 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c111d95-0ec2-4b75-af6e-04efe8e84a3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26da613-277e-421c-83a8-0f67fa307d80]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:46 user nova-compute[75051]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)
Nov 24 19:30:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:30:46 user nova-compute[75051]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 (non-flash)
Nov 24 19:30:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a04bf9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c990db-d24f-416a-9986-0187c46b3722]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04039074-14ab-4d80-9277-e36cdd962931]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cceb4e-f89b-44c5-bdac-71741a82023b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8cec35-4915-4cdc-ac45-80f3a491ce36]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bc4637-0c2a-49f4-a7fe-e48385f20071]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3bf71d-201c-49c5-a469-f25ec9cceed2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260]
Nov 24 19:30:46 user nova-compute[75051]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0, portal: 172.16.0.220,3260] successful.
Nov 24 19:30:46 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05cfdfd2-8a11-40ca-89a1-cfc002c10bc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe42303-e959-41bf-82c1-a4f1a3fc9443]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== disconnect_volume: return (301ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:30:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:30:47 user nova-compute[75051]: DEBUG nova.objects.instance [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:30:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-c31124f0-3514-4257-94eb-8012eac8fd43 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.639s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:30:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:30:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:30:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:04 user nova-compute[75051]: DEBUG nova.compute.manager [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing instance network info cache due to event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:31:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:31:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:31:04 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated VIF entry in instance network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.network.neutron [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:05 user nova-compute[75051]: INFO nova.compute.manager [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Detaching volume cabac2a0-4a86-4873-913d-4fe30487685b
Nov 24 19:31:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4e82f8ac-f6c1-4eb6-b33a-15730e559ccf req-1c3f1e46-d713-4733-924e-2cf882d658bd service nova] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:31:05 user nova-compute[75051]: INFO nova.virt.block_device [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Attempting to driver detach volume cabac2a0-4a86-4873-913d-4fe30487685b from mountpoint /dev/vdb
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Attempting to detach device vdb from instance a4acefaf-0d61-420b-998d-2c020099a21d from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:31:05 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:31:05 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:31:05 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:31:05 user nova-compute[75051]:   <serial>cabac2a0-4a86-4873-913d-4fe30487685b</serial>
Nov 24 19:31:05 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:31:05 user nova-compute[75051]: </disk>
Nov 24 19:31:05 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:31:05 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully detached device vdb from instance a4acefaf-0d61-420b-998d-2c020099a21d from the persistent domain config.
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4acefaf-0d61-420b-998d-2c020099a21d from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:31:05 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:31:05 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:31:05 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:31:05 user nova-compute[75051]:   <serial>cabac2a0-4a86-4873-913d-4fe30487685b</serial>
Nov 24 19:31:05 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:31:05 user nova-compute[75051]: </disk>
Nov 24 19:31:05 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:31:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:06 user nova-compute[75051]: DEBUG nova.compute.manager [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing instance network info cache due to event network-changed-7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:31:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:31:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:31:06 user nova-compute[75051]: DEBUG nova.network.neutron [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Refreshing network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:31:07 user nova-compute[75051]: DEBUG nova.network.neutron [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated VIF entry in instance network info cache for port 7075715a-6e45-48f0-b2a8-0f00ea21b877. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:31:07 user nova-compute[75051]: DEBUG nova.network.neutron [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5471d864-07e8-4e81-93d9-6ebb7c85b1fc req-ed732d74-0192-4dc7-bcd2-c62ffaaed013 service nova] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:31:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:15 user nova-compute[75051]: INFO nova.compute.manager [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Terminating instance
Nov 24 19:31:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-unplugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] No waiting events found dispatching network-vif-unplugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-5412e252-0e61-4a60-b840-400579873a02 req-44ed258f-a271-4eac-9684-22c0cac23ac7 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-unplugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Instance destroyed successfully.
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'resources' on Instance uuid 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247924935',display_name='tempest-AttachVolumeNegativeTest-server-1247924935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247924935',id=43,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9ydLiOYKDz2nw3Rp5Zq9nI1dUdOQj+idSw1s/tzH1y9JpQ0V6MWTVlKEEQWNQHfTq8Np5Ue9TS1dCL4eP6U+QpPgUSdAPLMZQcrETX/cwNfLU9pld7W5pLa9RFyz6FbQ==',key_name='tempest-keypair-628313693',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:28:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-x8dctsw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:28:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=1ee5f10e-dd2f-4b43-b51f-bc8570a8d387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "address": "fa:16:3e:e5:a9:19", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bbc048-b9", "ovs_interfaceid": "43bbc048-b97c-4d55-b96f-d2d8afc348bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG os_vif [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43bbc048-b9, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dcea1e3-47f4-407a-91e7-8989b306cfea) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:16 user nova-compute[75051]: INFO os_vif [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:a9:19,bridge_name='br-int',has_traffic_filtering=True,id=43bbc048-b97c-4d55-b96f-d2d8afc348bb,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bbc048-b9')
Nov 24 19:31:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Deleting instance files /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387_del
Nov 24 19:31:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Deletion of /opt/stack/data/nova/instances/1ee5f10e-dd2f-4b43-b51f-bc8570a8d387_del complete
Nov 24 19:31:16 user nova-compute[75051]: INFO nova.compute.manager [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 19:31:16 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:31:16 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:17 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Took 0.68 seconds to deallocate network for instance.
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-94adbe03-edb6-4795-a6ae-d6a67dba7eb3 req-a8068440-961d-4a8d-9dec-adc92c1494a6 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-deleted-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:17 user nova-compute[75051]: INFO nova.compute.manager [req-94adbe03-edb6-4795-a6ae-d6a67dba7eb3 req-a8068440-961d-4a8d-9dec-adc92c1494a6 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Neutron deleted interface 43bbc048-b97c-4d55-b96f-d2d8afc348bb; detaching it from the instance and deleting it from the info cache
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.network.neutron [req-94adbe03-edb6-4795-a6ae-d6a67dba7eb3 req-a8068440-961d-4a8d-9dec-adc92c1494a6 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-94adbe03-edb6-4795-a6ae-d6a67dba7eb3 req-a8068440-961d-4a8d-9dec-adc92c1494a6 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Detach interface failed, port_id=43bbc048-b97c-4d55-b96f-d2d8afc348bb, reason: Instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:31:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:17 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Deleted allocations for instance 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387
Nov 24 19:31:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1d29005d-ecc5-45b1-bd1f-978b254ea6af tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.942s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] Acquiring lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:18 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] Lock "1ee5f10e-dd2f-4b43-b51f-bc8570a8d387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:18 user nova-compute[75051]: DEBUG nova.compute.manager [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] No waiting events found dispatching network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:31:18 user nova-compute[75051]: WARNING nova.compute.manager [req-fa71c824-c458-4c25-9625-ae1ce9e624d0 req-fcb8578d-98bb-4d35-a7c4-ae47140da281 service nova] [instance: 1ee5f10e-dd2f-4b43-b51f-bc8570a8d387] Received unexpected event network-vif-plugged-43bbc048-b97c-4d55-b96f-d2d8afc348bb for instance with vm_state deleted and task_state None.
Nov 24 19:31:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:25 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4acefaf-0d61-420b-998d-2c020099a21d is timed out.
Nov 24 19:31:25 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully detached device vdb from instance a4acefaf-0d61-420b-998d-2c020099a21d from the live domain config.
Nov 24 19:31:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CTkcFeVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:31:25 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a490a6-201a-4739-b456-7894e587f0c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:31:25 user nova-compute[75051]: No targets found.
Nov 24 19:31:25 user nova-compute[75051]: iSNS:
Nov 24 19:31:25 user nova-compute[75051]: No targets found.
Nov 24 19:31:25 user nova-compute[75051]: STATIC:
Nov 24 19:31:25 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b
Nov 24 19:31:25 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:31:25 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:31:25 user nova-compute[75051]: FIRMWARE:
Nov 24 19:31:25 user nova-compute[75051]: No targets found.
Nov 24 19:31:25 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:31:25 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:31:25 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[93005c9e-67b6-44e7-bdf9-dd3a73e28363]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1794a-88fb-42fe-aa03-ba88ced5231f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:31:25 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b (non-flash)
Nov 24 19:31:25 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a03131c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20ecd6a-363b-402c-9723-e8e16f746d03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8448eb-6f89-428d-b13b-64bbfd320643]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28ec3f8-0a04-4e83-9318-380764081c9b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2946628e-dfde-447e-8330-c42ffa594499]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f1602-9494-4816-aebc-393f3b1c4459]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e609600c-67a6-4c9b-b558-541f538dfb07]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260]
Nov 24 19:31:25 user nova-compute[75051]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b, portal: 172.16.0.220,3260] successful.
Nov 24 19:31:25 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cabac2a0-4a86-4873-913d-4fe30487685b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49fec1-035c-4834-b9d9-9bbe6946ba68]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] <== disconnect_volume: return (293ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:31:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG nova.objects.instance [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'flavor' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-746e07a9-a7dc-44f5-b50e-1a3c1d33e796 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:31:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:35 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:31:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:31:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.14690399169922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance a4acefaf-0d61-420b-998d-2c020099a21d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:31:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:31:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:31:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:31:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:31:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:31:43 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:31:44 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [{"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-a4acefaf-0d61-420b-998d-2c020099a21d" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:31:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:31:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:31:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:55 user nova-compute[75051]: INFO nova.compute.manager [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Terminating instance
Nov 24 19:31:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-4b743411-d7cb-4821-b0a1-79a6719d8873 req-5cc89f12-ad69-4d5b-a125-800db856eda2 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-unplugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Instance destroyed successfully.
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid a4acefaf-0d61-420b-998d-2c020099a21d {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:25:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-541612196',display_name='tempest-ServerRescueNegativeTestJSON-server-541612196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-541612196',id=42,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdX8CWmzI2X4rnTympT1gQ0O1AU32mC5vzcp562rmWd7yJGOR+ImbsdKj+W+Tf6FmublYFzaTR2hnkb7dKaSDRZSRFX0IlAptkC4faHC2GR15pUI7IlLCZ95Oya6jF4Qg==',key_name='tempest-keypair-342125342',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:27:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-04efiojo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=a4acefaf-0d61-420b-998d-2c020099a21d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "address": "fa:16:3e:cd:c4:15", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7075715a-6e", "ovs_interfaceid": "7075715a-6e45-48f0-b2a8-0f00ea21b877", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG os_vif [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7075715a-6e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09c12d6a-903d-47bb-80cc-0c11ffcb41d6) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:31:56 user nova-compute[75051]: INFO os_vif [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:c4:15,bridge_name='br-int',has_traffic_filtering=True,id=7075715a-6e45-48f0-b2a8-0f00ea21b877,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7075715a-6e')
Nov 24 19:31:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Deleting instance files /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d_del
Nov 24 19:31:56 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Deletion of /opt/stack/data/nova/instances/a4acefaf-0d61-420b-998d-2c020099a21d_del complete
Nov 24 19:31:56 user nova-compute[75051]: INFO nova.compute.manager [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 24 19:31:56 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:31:56 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:31:57 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Took 1.28 seconds to deallocate network for instance.
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-c19b978a-0820-4b43-bd9b-8a04bbe74ace req-2fd8ddf5-ce84-4d9b-a5cb-b969f480cdba service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-deleted-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] Acquiring lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] Lock "a4acefaf-0d61-420b-998d-2c020099a21d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.compute.manager [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] No waiting events found dispatching network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:31:57 user nova-compute[75051]: WARNING nova.compute.manager [req-1b2c67eb-0f9d-4ba6-af28-8e47f8dbb2a5 req-e4f0e050-5e06-4570-97f8-b0ed7aae7713 service nova] [instance: a4acefaf-0d61-420b-998d-2c020099a21d] Received unexpected event network-vif-plugged-7075715a-6e45-48f0-b2a8-0f00ea21b877 for instance with vm_state deleted and task_state None.
Nov 24 19:31:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:31:57 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Deleted allocations for instance a4acefaf-0d61-420b-998d-2c020099a21d
Nov 24 19:31:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-345b552b-4a67-433b-8643-e859d3775351 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "a4acefaf-0d61-420b-998d-2c020099a21d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:32:09 user nova-compute[75051]: INFO nova.compute.claims [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Claim successful on node user
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:32:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.policy [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '918f479d20f449848b5b088b6aaf64d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c244443230f42adbf13dbcb8405247e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:32:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Creating image(s)
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "/opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "/opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk 1073741824" returned: 0 in 0.049s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Successfully created port: 90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Cannot resize image /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Ensure instance console log exists: /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Successfully updated port: 90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquired lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-changed-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.compute.manager [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Refreshing instance network info cache due to event network-changed-90cdc480-bb4b-469a-a84c-f377c486bbe4. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] Acquiring lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Releasing lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Instance network_info: |[{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] Acquired lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Refreshing network info cache for port 90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Start _get_guest_xml network_info=[{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:32:11 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:32:11 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1277228335',display_name='tempest-AttachVolumeNegativeTest-server-1277228335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1277228335',id=44,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhTg+uy1dN24rMpKdDGc8ZIG3pqj903C0fSodLJyHLlDvjkSA/03YXUiDMwR5ztfUDaQ38V2Et4azRUyE2E+GBaA79RLlqMzjYKTiY+VWFLsCbQw+z4X+O12yEHo3q6hg==',key_name='tempest-keypair-1595739719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-y1k738qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=c49441cb-05c3-4c88-95ed-f584037a2a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.objects.instance [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'pci_devices' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:32:11 user nova-compute[75051]:   <uuid>c49441cb-05c3-4c88-95ed-f584037a2a3c</uuid>
Nov 24 19:32:11 user nova-compute[75051]:   <name>instance-0000002c</name>
Nov 24 19:32:11 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:32:11 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:32:11 user nova-compute[75051]:   <metadata>
Nov 24 19:32:11 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:32:11 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1277228335</nova:name>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:32:11</nova:creationTime>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:32:11 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:32:11 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:owner>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:user uuid="918f479d20f449848b5b088b6aaf64d7">tempest-AttachVolumeNegativeTest-1689022931-project-member</nova:user>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:project uuid="0c244443230f42adbf13dbcb8405247e">tempest-AttachVolumeNegativeTest-1689022931</nova:project>
Nov 24 19:32:11 user nova-compute[75051]:       </nova:owner>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:32:11 user nova-compute[75051]:       <nova:ports>
Nov 24 19:32:11 user nova-compute[75051]:         <nova:port uuid="90cdc480-bb4b-469a-a84c-f377c486bbe4">
Nov 24 19:32:11 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 24 19:32:11 user nova-compute[75051]:         </nova:port>
Nov 24 19:32:11 user nova-compute[75051]:       </nova:ports>
Nov 24 19:32:11 user nova-compute[75051]:     </nova:instance>
Nov 24 19:32:11 user nova-compute[75051]:   </metadata>
Nov 24 19:32:11 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:32:11 user nova-compute[75051]:     <system>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="serial">c49441cb-05c3-4c88-95ed-f584037a2a3c</entry>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="uuid">c49441cb-05c3-4c88-95ed-f584037a2a3c</entry>
Nov 24 19:32:11 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:32:11 user nova-compute[75051]:     </system>
Nov 24 19:32:11 user nova-compute[75051]:   </sysinfo>
Nov 24 19:32:11 user nova-compute[75051]:   <os>
Nov 24 19:32:11 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:32:11 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:32:11 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:32:11 user nova-compute[75051]:   </os>
Nov 24 19:32:11 user nova-compute[75051]:   <features>
Nov 24 19:32:11 user nova-compute[75051]:     <acpi/>
Nov 24 19:32:11 user nova-compute[75051]:     <apic/>
Nov 24 19:32:11 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:32:11 user nova-compute[75051]:   </features>
Nov 24 19:32:11 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:32:11 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:32:11 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:32:11 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:32:11 user nova-compute[75051]:   </clock>
Nov 24 19:32:11 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:32:11 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:32:11 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:32:11 user nova-compute[75051]:   </cpu>
Nov 24 19:32:11 user nova-compute[75051]:   <devices>
Nov 24 19:32:11 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:32:11 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:32:11 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk"/>
Nov 24 19:32:11 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:32:11 user nova-compute[75051]:     </disk>
Nov 24 19:32:11 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:32:11 user nova-compute[75051]:       <mac address="fa:16:3e:99:f5:05"/>
Nov 24 19:32:11 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:32:11 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:32:11 user nova-compute[75051]:       <target dev="tap90cdc480-bb"/>
Nov 24 19:32:11 user nova-compute[75051]:     </interface>
Nov 24 19:32:11 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:32:11 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/console.log" append="off"/>
Nov 24 19:32:11 user nova-compute[75051]:     </serial>
Nov 24 19:32:11 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:32:11 user nova-compute[75051]:     <video>
Nov 24 19:32:11 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:32:11 user nova-compute[75051]:     </video>
Nov 24 19:32:11 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:32:11 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:32:11 user nova-compute[75051]:     </rng>
Nov 24 19:32:11 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:32:11 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:32:11 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:32:11 user nova-compute[75051]:     </memballoon>
Nov 24 19:32:11 user nova-compute[75051]:   </devices>
Nov 24 19:32:11 user nova-compute[75051]: </domain>
Nov 24 19:32:11 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1277228335',display_name='tempest-AttachVolumeNegativeTest-server-1277228335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1277228335',id=44,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhTg+uy1dN24rMpKdDGc8ZIG3pqj903C0fSodLJyHLlDvjkSA/03YXUiDMwR5ztfUDaQ38V2Et4azRUyE2E+GBaA79RLlqMzjYKTiY+VWFLsCbQw+z4X+O12yEHo3q6hg==',key_name='tempest-keypair-1595739719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-y1k738qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:32:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=c49441cb-05c3-4c88-95ed-f584037a2a3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG os_vif [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14653a84-5344-5a04-923d-1beda980cbdf', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90cdc480-bb, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90cdc480-bb, col_values=(('qos', UUID('3282fddd-a6f6-4cd3-9ebd-1777be01ecf9')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90cdc480-bb, col_values=(('external_ids', {'iface-id': '90cdc480-bb4b-469a-a84c-f377c486bbe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:f5:05', 'vm-uuid': 'c49441cb-05c3-4c88-95ed-f584037a2a3c'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:11 user nova-compute[75051]: INFO os_vif [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb')
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:99:f5:05, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updated VIF entry in instance network info cache for port 90cdc480-bb4b-469a-a84c-f377c486bbe4. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG nova.network.neutron [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:32:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-71d81a72-6ef7-4ccb-9304-fcddabb88e7f req-a824db42-3e84-4c9c-a038-5c774b369f62 service nova] Releasing lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:32:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] No waiting events found dispatching network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:32:13 user nova-compute[75051]: WARNING nova.compute.manager [req-33c584f2-a377-4f69-9176-64271046eed8 req-da13f0a2-b7df-4f60-8454-12386fda9dc5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received unexpected event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 for instance with vm_state building and task_state spawning.
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:32:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Instance spawned successfully.
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:32:15 user nova-compute[75051]: INFO nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] No waiting events found dispatching network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:32:15 user nova-compute[75051]: WARNING nova.compute.manager [req-124a6133-3235-453d-974c-91938edc8e75 req-ecb394dc-28de-4384-96d2-4c6dfafab677 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received unexpected event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 for instance with vm_state building and task_state spawning.
Nov 24 19:32:15 user nova-compute[75051]: INFO nova.compute.manager [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Took 5.88 seconds to build instance.
Nov 24 19:32:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-530abe7c-9d1a-4b6d-b506-fab28dac87b3 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.970s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:32:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:35 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:32:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:32:37 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.13878631591797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c314a125-ae40-4829-af87-09288fd1d85a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c49441cb-05c3-4c88-95ed-f584037a2a3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:32:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:32:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:32:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:32:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:32:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:32:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:32:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:49 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:53 user nova-compute[75051]: INFO nova.compute.manager [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Terminating instance
Nov 24 19:32:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-8ee564cf-162d-4f1c-b5ba-df55fe5d4a00 req-64350eb1-8f6b-4595-b334-0324455b5675 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-unplugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Instance destroyed successfully.
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid c314a125-ae40-4829-af87-09288fd1d85a {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-656798778',display_name='tempest-ServerRescueNegativeTestJSON-server-656798778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-656798778',id=37,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-wclbhxj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:18:45Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=c314a125-ae40-4829-af87-09288fd1d85a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "address": "fa:16:3e:13:dc:c7", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf1e8820-01", "ovs_interfaceid": "cf1e8820-01b2-4c72-934e-ef5e5a52874b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG os_vif [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf1e8820-01, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4d53d92-e594-420a-8ef5-bc6ee98ab1c8) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:32:54 user nova-compute[75051]: INFO os_vif [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:dc:c7,bridge_name='br-int',has_traffic_filtering=True,id=cf1e8820-01b2-4c72-934e-ef5e5a52874b,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf1e8820-01')
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Deleting instance files /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a_del
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Deletion of /opt/stack/data/nova/instances/c314a125-ae40-4829-af87-09288fd1d85a_del complete
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.compute.manager [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 24 19:32:54 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Took 0.56 seconds to deallocate network for instance.
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-71952e4b-499d-4ca4-beb0-43922a116eb4 req-963f3b40-afae-4f09-b10c-db71198f914c service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-deleted-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:54 user nova-compute[75051]: INFO nova.compute.manager [req-71952e4b-499d-4ca4-beb0-43922a116eb4 req-963f3b40-afae-4f09-b10c-db71198f914c service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Neutron deleted interface cf1e8820-01b2-4c72-934e-ef5e5a52874b; detaching it from the instance and deleting it from the info cache
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-71952e4b-499d-4ca4-beb0-43922a116eb4 req-963f3b40-afae-4f09-b10c-db71198f914c service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-71952e4b-499d-4ca4-beb0-43922a116eb4 req-963f3b40-afae-4f09-b10c-db71198f914c service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Detach interface failed, port_id=cf1e8820-01b2-4c72-934e-ef5e5a52874b, reason: Instance c314a125-ae40-4829-af87-09288fd1d85a could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:55 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Deleted allocations for instance c314a125-ae40-4829-af87-09288fd1d85a
Nov 24 19:32:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-e41fdcbb-de3c-4e5c-8332-59a96f0f6fd4 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "c314a125-ae40-4829-af87-09288fd1d85a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.823s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] Acquiring lock "c314a125-ae40-4829-af87-09288fd1d85a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] Lock "c314a125-ae40-4829-af87-09288fd1d85a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:32:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] No waiting events found dispatching network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:32:55 user nova-compute[75051]: WARNING nova.compute.manager [req-f2a40622-bc8e-4a46-aef9-5e563feeb5ca req-23949743-2b06-4e7a-8bbd-b5f04d3d9095 service nova] [instance: c314a125-ae40-4829-af87-09288fd1d85a] Received unexpected event network-vif-plugged-cf1e8820-01b2-4c72-934e-ef5e5a52874b for instance with vm_state deleted and task_state None.
Nov 24 19:32:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:33:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:33:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:33:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:33:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:33:39 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:33:39 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.16476058959961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 7efb1743-512a-4bda-9930-b03c160b98f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c49441cb-05c3-4c88-95ed-f584037a2a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:33:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:44 user nova-compute[75051]: INFO nova.compute.manager [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Terminating instance
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-f6d46019-6480-4d4d-b912-fce4a29b6d7c req-e8c977f7-0841-40e6-bded-43c50f831963 service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-unplugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Instance destroyed successfully.
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lazy-loading 'resources' on Instance uuid 7efb1743-512a-4bda-9930-b03c160b98f6 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-868253231',display_name='tempest-ServerRescueNegativeTestJSON-server-868253231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-868253231',id=36,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57b6b1989d844cd49bb0a70f2d52e309',ramdisk_id='',reservation_id='r-hqfjo7lq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-972671946',owner_user_name='tempest-ServerRescueNegativeTestJSON-972671946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:23:30Z,user_data=None,user_id='37067adbbf3746ccb3aa3ad60b617217',uuid=7efb1743-512a-4bda-9930-b03c160b98f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converting VIF {"id": "350e9cdb-e02f-41cc-853f-50b905a93655", "address": "fa:16:3e:e2:03:b8", "network": {"id": "1477ebb1-d676-41c1-bacc-85aff89fd0a3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-305599921-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57b6b1989d844cd49bb0a70f2d52e309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350e9cdb-e0", "ovs_interfaceid": "350e9cdb-e02f-41cc-853f-50b905a93655", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG os_vif [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350e9cdb-e0, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bba0ba68-abc6-4151-a800-8493417fe68a) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:44 user nova-compute[75051]: INFO os_vif [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:03:b8,bridge_name='br-int',has_traffic_filtering=True,id=350e9cdb-e02f-41cc-853f-50b905a93655,network=Network(1477ebb1-d676-41c1-bacc-85aff89fd0a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350e9cdb-e0')
Nov 24 19:33:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Deleting instance files /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6_del
Nov 24 19:33:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Deletion of /opt/stack/data/nova/instances/7efb1743-512a-4bda-9930-b03c160b98f6_del complete
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:44 user nova-compute[75051]: INFO nova.compute.manager [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 24 19:33:44 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:33:44 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:33:45 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Took 0.42 seconds to deallocate network for instance.
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-9125000f-5a30-4759-9bdb-e55b6176cea7 req-6003601e-510e-4a24-8977-060637498cff service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-deleted-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:33:45 user nova-compute[75051]: INFO nova.compute.manager [req-9125000f-5a30-4759-9bdb-e55b6176cea7 req-6003601e-510e-4a24-8977-060637498cff service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Neutron deleted interface 350e9cdb-e02f-41cc-853f-50b905a93655; detaching it from the instance and deleting it from the info cache
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.network.neutron [req-9125000f-5a30-4759-9bdb-e55b6176cea7 req-6003601e-510e-4a24-8977-060637498cff service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-9125000f-5a30-4759-9bdb-e55b6176cea7 req-6003601e-510e-4a24-8977-060637498cff service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Detach interface failed, port_id=350e9cdb-e02f-41cc-853f-50b905a93655, reason: Instance 7efb1743-512a-4bda-9930-b03c160b98f6 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:33:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:45 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Deleted allocations for instance 7efb1743-512a-4bda-9930-b03c160b98f6
Nov 24 19:33:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b0c4464a-7443-44e9-a315-f8b5651fad71 tempest-ServerRescueNegativeTestJSON-972671946 tempest-ServerRescueNegativeTestJSON-972671946-project-member] Lock "7efb1743-512a-4bda-9930-b03c160b98f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.594s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] Acquiring lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] Lock "7efb1743-512a-4bda-9930-b03c160b98f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] No waiting events found dispatching network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:33:46 user nova-compute[75051]: WARNING nova.compute.manager [req-977d4a86-7e93-4877-9572-e81f9db869d1 req-c4505e16-6f4c-4e58-aafe-31da64051c2e service nova] [instance: 7efb1743-512a-4bda-9930-b03c160b98f6] Received unexpected event network-vif-plugged-350e9cdb-e02f-41cc-853f-50b905a93655 for instance with vm_state deleted and task_state None.
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:33:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:33:47 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:33:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:33:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:33:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:33:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:33:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:33:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-changed-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Refreshing instance network info cache due to event network-changed-90cdc480-bb4b-469a-a84c-f377c486bbe4. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] Acquiring lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] Acquired lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Refreshing network info cache for port 90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updated VIF entry in instance network info cache for port 90cdc480-bb4b-469a-a84c-f377c486bbe4. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:34:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d5e26ad5-4e66-4846-9752-6d2c99c2ec1d req-2503cd3b-9c0b-4b34-b9d1-6e77f62d2d00 service nova] Releasing lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:34:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:34:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:34:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:34:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:34:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:34:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:34:04 user nova-compute[75051]: INFO nova.compute.manager [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Attaching volume 8c1f924b-dac1-41e6-ace6-743fc87dd739 to /dev/vdb
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.utils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20de1052-5afc-4f2b-9505-4e0e17425192]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6500d90-f0c5-49e1-95ec-7d30d1540ebf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3217400-5bc0-4b59-aabd-be46cc6ee76e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e6d48f-44bd-4b5a-ab3e-647e5bc9b008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:34:04 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:34:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3511ad84-60a5-4847-9934-bba9e814dd58]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG os_brick.utils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating existing volume attachment record: 7fe158c2-371a-4bba-98d3-8151dbe2a7ce {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:34:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAXTJunU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:34:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:34:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:34:10 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9829fe-2c1e-4ba6-9af8-6add8f209d0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:34:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c85f7a5-e792-47fb-90ce-0f29db06929e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739] added
Nov 24 19:34:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b2a7b-6b9d-4f37-ad4c-2258c6aa033f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29f5e91-d62c-4c06-a20a-6dd9dacb684a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAXTJunU {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAXTJunU" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae30f2-4aae-431a-9674-31131f0a6f2f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAXTJunU'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a591bb2-a492-41e8-8650-b086d3ab6df2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8807f0b-9177-4e80-b136-ad238fc67ae5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:34:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:34:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:34:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:34:10 user nova-compute[75051]: 
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1acd56-c42c-4420-a36f-16eaa703820f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260]
Nov 24 19:34:10 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260] successful.
Nov 24 19:34:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33869ae-dfa1-4fda-9b47-0a565fabd0e3]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4df11b-b3bd-4b92-9caf-3b91770d5ffe]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)
Nov 24 19:34:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)
Nov 24 19:34:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be0600f-a4ae-456f-8508-dc751c70886d]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:34:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAXTJunU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26233313032626636', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233313032626636', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.objects.instance [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:34:11 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:34:11 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:34:11 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:34:11 user nova-compute[75051]:   <serial>8c1f924b-dac1-41e6-ace6-743fc87dd739</serial>
Nov 24 19:34:11 user nova-compute[75051]: </disk>
Nov 24 19:34:11 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:34:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] No VIF found with MAC fa:16:3e:99:f5:05, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:34:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-045bc3ea-5f8a-4b91-a992-8269a79298f7 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.877s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:34:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:34:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:34:13 user nova-compute[75051]: INFO nova.compute.manager [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Detaching volume 8c1f924b-dac1-41e6-ace6-743fc87dd739
Nov 24 19:34:13 user nova-compute[75051]: INFO nova.virt.block_device [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Attempting to driver detach volume 8c1f924b-dac1-41e6-ace6-743fc87dd739 from mountpoint /dev/vdb
Nov 24 19:34:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Attempting to detach device vdb from instance c49441cb-05c3-4c88-95ed-f584037a2a3c from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:34:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:34:13 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:34:13 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:34:13 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:34:13 user nova-compute[75051]:   <serial>8c1f924b-dac1-41e6-ace6-743fc87dd739</serial>
Nov 24 19:34:13 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:34:13 user nova-compute[75051]: </disk>
Nov 24 19:34:13 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:34:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance c49441cb-05c3-4c88-95ed-f584037a2a3c from the persistent domain config.
Nov 24 19:34:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c49441cb-05c3-4c88-95ed-f584037a2a3c from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:34:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:34:13 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:34:13 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:34:13 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:34:13 user nova-compute[75051]:   <serial>8c1f924b-dac1-41e6-ace6-743fc87dd739</serial>
Nov 24 19:34:13 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:34:13 user nova-compute[75051]: </disk>
Nov 24 19:34:13 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:34:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:34:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:33 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c49441cb-05c3-4c88-95ed-f584037a2a3c is timed out.
Nov 24 19:34:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully detached device vdb from instance c49441cb-05c3-4c88-95ed-f584037a2a3c from the live domain config.
Nov 24 19:34:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAXTJunU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:34:33 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75029a17-9ddf-4fc4-9b6a-f121b7032185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:34:33 user nova-compute[75051]: No targets found.
Nov 24 19:34:33 user nova-compute[75051]: iSNS:
Nov 24 19:34:33 user nova-compute[75051]: No targets found.
Nov 24 19:34:33 user nova-compute[75051]: STATIC:
Nov 24 19:34:33 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739
Nov 24 19:34:33 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:34:33 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:34:33 user nova-compute[75051]: FIRMWARE:
Nov 24 19:34:33 user nova-compute[75051]: No targets found.
Nov 24 19:34:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:34:33 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:34:33 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f1cb24-ef71-4dd9-9cf3-1a36b959bc6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bb837f-8df4-49ee-93fb-1b165b5abfa1]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)
Nov 24 19:34:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 (non-flash)
Nov 24 19:34:33 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0442710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f7a48-e71e-4895-9925-6d4a298bac87]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdaa75-d66c-4a26-aa72-dd3ed410206c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a6561b-578e-4305-b4d2-d4d002246ed8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[634ad0c9-1871-4ff9-94f5-d52f6b4f2b3c]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e0443-1f10-4a34-8d8a-85aff8a961d7]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9e16d-9c6f-4857-b27b-7632eb3e3a44]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260]
Nov 24 19:34:34 user nova-compute[75051]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739, portal: 172.16.0.220,3260] successful.
Nov 24 19:34:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c1f924b-dac1-41e6-ace6-743fc87dd739 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb06a2c-a7a3-4cb7-a725-dd255772a999]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] <== disconnect_volume: return (303ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG nova.objects.instance [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'flavor' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:34:34 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-39745dca-27f2-4509-aaec-c92e85b0ee5f tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:34:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:34:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:34:38 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:34:38 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.191505432128906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance c49441cb-05c3-4c88-95ed-f584037a2a3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:34:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:34:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:34:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:34:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:34:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:34:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:34:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [{"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-c49441cb-05c3-4c88-95ed-f584037a2a3c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:34:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:34:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:34:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:34:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:03 user nova-compute[75051]: INFO nova.compute.manager [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Terminating instance
Nov 24 19:35:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-unplugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] No waiting events found dispatching network-vif-unplugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:35:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-2a031f80-4427-4106-a4b7-e32d1803817d req-12890f7c-a137-4c01-b9c9-0ff6ff7e53e5 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-unplugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Instance destroyed successfully.
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lazy-loading 'resources' on Instance uuid c49441cb-05c3-4c88-95ed-f584037a2a3c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:32:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1277228335',display_name='tempest-AttachVolumeNegativeTest-server-1277228335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1277228335',id=44,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhTg+uy1dN24rMpKdDGc8ZIG3pqj903C0fSodLJyHLlDvjkSA/03YXUiDMwR5ztfUDaQ38V2Et4azRUyE2E+GBaA79RLlqMzjYKTiY+VWFLsCbQw+z4X+O12yEHo3q6hg==',key_name='tempest-keypair-1595739719',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:32:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c244443230f42adbf13dbcb8405247e',ramdisk_id='',reservation_id='r-y1k738qi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1689022931',owner_user_name='tempest-AttachVolumeNegativeTest-1689022931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='918f479d20f449848b5b088b6aaf64d7',uuid=c49441cb-05c3-4c88-95ed-f584037a2a3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converting VIF {"id": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "address": "fa:16:3e:99:f5:05", "network": {"id": "3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-860826133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c244443230f42adbf13dbcb8405247e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90cdc480-bb", "ovs_interfaceid": "90cdc480-bb4b-469a-a84c-f377c486bbe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG os_vif [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90cdc480-bb, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3282fddd-a6f6-4cd3-9ebd-1777be01ecf9) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:04 user nova-compute[75051]: INFO os_vif [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:f5:05,bridge_name='br-int',has_traffic_filtering=True,id=90cdc480-bb4b-469a-a84c-f377c486bbe4,network=Network(3bf1cf5c-3796-4e6d-9a39-196c7b2e76e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90cdc480-bb')
Nov 24 19:35:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Deleting instance files /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c_del
Nov 24 19:35:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Deletion of /opt/stack/data/nova/instances/c49441cb-05c3-4c88-95ed-f584037a2a3c_del complete
Nov 24 19:35:04 user nova-compute[75051]: INFO nova.compute.manager [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 24 19:35:04 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:35:04 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-182a4e8e-71ac-4b3d-a58d-2f047733c135 req-7a3e5bb3-1464-430f-89a4-6a24ebf7db49 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-deleted-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:35:05 user nova-compute[75051]: INFO nova.compute.manager [req-182a4e8e-71ac-4b3d-a58d-2f047733c135 req-7a3e5bb3-1464-430f-89a4-6a24ebf7db49 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Neutron deleted interface 90cdc480-bb4b-469a-a84c-f377c486bbe4; detaching it from the instance and deleting it from the info cache
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.network.neutron [req-182a4e8e-71ac-4b3d-a58d-2f047733c135 req-7a3e5bb3-1464-430f-89a4-6a24ebf7db49 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:35:05 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Took 0.85 seconds to deallocate network for instance.
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-182a4e8e-71ac-4b3d-a58d-2f047733c135 req-7a3e5bb3-1464-430f-89a4-6a24ebf7db49 service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Detach interface failed, port_id=90cdc480-bb4b-469a-a84c-f377c486bbe4, reason: Instance c49441cb-05c3-4c88-95ed-f584037a2a3c could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:05 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Deleted allocations for instance c49441cb-05c3-4c88-95ed-f584037a2a3c
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f00d2d84-b15b-4c9d-a3da-9989a77018d5 tempest-AttachVolumeNegativeTest-1689022931 tempest-AttachVolumeNegativeTest-1689022931-project-member] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] Acquiring lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] Lock "c49441cb-05c3-4c88-95ed-f584037a2a3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] No waiting events found dispatching network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:35:05 user nova-compute[75051]: WARNING nova.compute.manager [req-0e296b22-fa4e-40fd-8ab8-d99d90bdd3c9 req-33c34cdf-0508-419c-89dd-eb8f205185fa service nova] [instance: c49441cb-05c3-4c88-95ed-f584037a2a3c] Received unexpected event network-vif-plugged-90cdc480-bb4b-469a-a84c-f377c486bbe4 for instance with vm_state deleted and task_state None.
Nov 24 19:35:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:35:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:34 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:34 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:39 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:35:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9091MB free_disk=25.216514587402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:35:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:35:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:35:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:35:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:35:58 user nova-compute[75051]: INFO nova.compute.claims [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Claim successful on node user
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:35:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:35:58 user nova-compute[75051]: DEBUG nova.policy [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:35:58 user nova-compute[75051]: INFO nova.virt.block_device [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Booting with volume snapshot cc17f545-764d-4fd7-9c79-839aa3cca894 at /dev/vda
Nov 24 19:35:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Successfully created port: 763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:35:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:35:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Successfully updated port: 763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-changed-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.compute.manager [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Refreshing instance network info cache due to event network-changed-763549b2-db3b-41ba-8146-15fef7ae2a03. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] Acquiring lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updating instance_info_cache with network_info: [{"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Instance network_info: |[{"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] Acquired lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Refreshing network info cache for port 763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updated VIF entry in instance network info cache for port 763549b2-db3b-41ba-8146-15fef7ae2a03. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG nova.network.neutron [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updating instance_info_cache with network_info: [{"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:36:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-4906fa85-dbf2-4717-9a83-c793bfa7b851 req-1fe1598f-d9e5-4635-870c-ef244bd23815 service nova] Releasing lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:36:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.utils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[485ad85a-bc53-4b32-a105-474b3d0811d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fdb49-3f8f-4138-9438-2269f134dddf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04f442-73f5-459f-a53a-f5bd36379b09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb5c7f-0d74-4af2-8e12-5762162043a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:36:04 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:36:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce293a4-edb0-4d0e-b094-7518caa0d4ce]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG os_brick.utils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updating existing volume attachment record: 4cd861ba-3dd2-488d-a826-cf94834bd354 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:36:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:36:10 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Creating image(s)
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Ensure instance console log exists: /opt/stack/data/nova/instances/bf0e700b-5ed4-4617-9b2c-ece87e8ba039/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Start _get_guest_xml network_info=[{"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVbufarP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bf0e700b-5ed4-4617-9b2c-ece87e8ba039', 'attached_at': '', 'detached_at': '', 'volume_id': 'db7ad476-f766-41c1-86c7-7806f0277555', 'serial': 'db7ad476-f766-41c1-86c7-7806f0277555'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '4cd861ba-3dd2-488d-a826-cf94834bd354', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:36:10 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:10 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVbufarP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:36:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:36:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:36:10 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[863d5707-9ef6-4372-9900-5944452e99db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:36:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d092506-26d7-41b3-a1b9-a4a92111974b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555] added
Nov 24 19:36:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aebd8f-41c3-4f94-b739-1b89c367c639]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d0373-9f07-46f3-a132-951306df5274]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVbufarP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nVbufarP" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5626dac-2196-4d60-9075-36f7f3096a11]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nVbufarP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de14b950-98fd-4d50-90f6-3dfeddf80b19]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[de17fc1c-9560-4e57-8e56-c98cb5af6af2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:36:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:36:10 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:36:10 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:36:10 user nova-compute[75051]: 
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951225b-b37a-4a5e-9ab3-822ed993a324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260]
Nov 24 19:36:10 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260] successful.
Nov 24 19:36:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e9559-333f-4032-9f6f-f23bcb1c3dec]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba02aa-dff4-489b-a679-e31469e3e333]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)
Nov 24 19:36:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)
Nov 24 19:36:10 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd8641a-e078-4cb2-a79f-417b5d8d5850]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:36:10 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVbufarP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:36:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:36:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26266393432396538', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:36:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266393432396538', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875855520',display_name='tempest-TestVolumeBootPattern-server-1875855520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875855520',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-35re78k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:35:59Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=bf0e700b-5ed4-4617-9b2c-ece87e8ba039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid bf0e700b-5ed4-4617-9b2c-ece87e8ba039 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:36:12 user nova-compute[75051]:   <uuid>bf0e700b-5ed4-4617-9b2c-ece87e8ba039</uuid>
Nov 24 19:36:12 user nova-compute[75051]:   <name>instance-0000002d</name>
Nov 24 19:36:12 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:36:12 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:36:12 user nova-compute[75051]:   <metadata>
Nov 24 19:36:12 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:36:12 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:36:12 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-server-1875855520</nova:name>
Nov 24 19:36:12 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:36:10</nova:creationTime>
Nov 24 19:36:12 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:36:12 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:36:12 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:36:12 user nova-compute[75051]:       <nova:owner>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:36:12 user nova-compute[75051]:       </nova:owner>
Nov 24 19:36:12 user nova-compute[75051]:       <nova:ports>
Nov 24 19:36:12 user nova-compute[75051]:         <nova:port uuid="763549b2-db3b-41ba-8146-15fef7ae2a03">
Nov 24 19:36:12 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 24 19:36:12 user nova-compute[75051]:         </nova:port>
Nov 24 19:36:12 user nova-compute[75051]:       </nova:ports>
Nov 24 19:36:12 user nova-compute[75051]:     </nova:instance>
Nov 24 19:36:12 user nova-compute[75051]:   </metadata>
Nov 24 19:36:12 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:36:12 user nova-compute[75051]:     <system>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="serial">bf0e700b-5ed4-4617-9b2c-ece87e8ba039</entry>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="uuid">bf0e700b-5ed4-4617-9b2c-ece87e8ba039</entry>
Nov 24 19:36:12 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:36:12 user nova-compute[75051]:     </system>
Nov 24 19:36:12 user nova-compute[75051]:   </sysinfo>
Nov 24 19:36:12 user nova-compute[75051]:   <os>
Nov 24 19:36:12 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:36:12 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:36:12 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:36:12 user nova-compute[75051]:   </os>
Nov 24 19:36:12 user nova-compute[75051]:   <features>
Nov 24 19:36:12 user nova-compute[75051]:     <acpi/>
Nov 24 19:36:12 user nova-compute[75051]:     <apic/>
Nov 24 19:36:12 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:36:12 user nova-compute[75051]:   </features>
Nov 24 19:36:12 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:36:12 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:36:12 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:36:12 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:36:12 user nova-compute[75051]:   </clock>
Nov 24 19:36:12 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:36:12 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:36:12 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:36:12 user nova-compute[75051]:   </cpu>
Nov 24 19:36:12 user nova-compute[75051]:   <devices>
Nov 24 19:36:12 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:36:12 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:36:12 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 19:36:12 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:36:12 user nova-compute[75051]:       <serial>db7ad476-f766-41c1-86c7-7806f0277555</serial>
Nov 24 19:36:12 user nova-compute[75051]:     </disk>
Nov 24 19:36:12 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:36:12 user nova-compute[75051]:       <mac address="fa:16:3e:cb:5c:cf"/>
Nov 24 19:36:12 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:36:12 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:36:12 user nova-compute[75051]:       <target dev="tap763549b2-db"/>
Nov 24 19:36:12 user nova-compute[75051]:     </interface>
Nov 24 19:36:12 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:36:12 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/bf0e700b-5ed4-4617-9b2c-ece87e8ba039/console.log" append="off"/>
Nov 24 19:36:12 user nova-compute[75051]:     </serial>
Nov 24 19:36:12 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:36:12 user nova-compute[75051]:     <video>
Nov 24 19:36:12 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:36:12 user nova-compute[75051]:     </video>
Nov 24 19:36:12 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:36:12 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:36:12 user nova-compute[75051]:     </rng>
Nov 24 19:36:12 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:36:12 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:36:12 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:36:12 user nova-compute[75051]:     </memballoon>
Nov 24 19:36:12 user nova-compute[75051]:   </devices>
Nov 24 19:36:12 user nova-compute[75051]: </domain>
Nov 24 19:36:12 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875855520',display_name='tempest-TestVolumeBootPattern-server-1875855520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875855520',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-35re78k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:35:59Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=bf0e700b-5ed4-4617-9b2c-ece87e8ba039,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG os_vif [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0863fa7-7a7c-5e50-ae08-e6e46bdd6e2f', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap763549b2-db, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap763549b2-db, col_values=(('qos', UUID('27ab903d-ad51-44c0-bc0f-d519b60dc850')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap763549b2-db, col_values=(('external_ids', {'iface-id': '763549b2-db3b-41ba-8146-15fef7ae2a03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:5c:cf', 'vm-uuid': 'bf0e700b-5ed4-4617-9b2c-ece87e8ba039'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:12 user nova-compute[75051]: INFO os_vif [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db')
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:36:12 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:cb:5c:cf, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] No waiting events found dispatching network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:36:13 user nova-compute[75051]: WARNING nova.compute.manager [req-d34284bb-f665-4799-8324-2246c0020e5d req-29bc095c-6a12-4ffa-bef6-8fbd7dc3bbda service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received unexpected event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 for instance with vm_state building and task_state spawning.
Nov 24 19:36:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] No waiting events found dispatching network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:36:15 user nova-compute[75051]: WARNING nova.compute.manager [req-3babb9f2-3adb-4193-ac6d-ec1a6d246908 req-ee2d61c1-e07e-4170-9da2-d8b5c3c10ad9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received unexpected event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 for instance with vm_state building and task_state spawning.
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:36:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Instance spawned successfully.
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:15 user nova-compute[75051]: INFO nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 24 19:36:15 user nova-compute[75051]: DEBUG nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:36:15 user nova-compute[75051]: INFO nova.compute.manager [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Took 17.83 seconds to build instance.
Nov 24 19:36:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-01864cfc-41fd-48a6-994c-51be1c261777 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.928s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:35 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:35 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:36:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:36:38 user nova-compute[75051]: INFO nova.compute.claims [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Claim successful on node user
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:36:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.policy [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b07774ec58e64468bccc87478606eff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa778076f1694362b069beeb0a81a043', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:36:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Creating image(s)
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "/opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "/opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.182s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk 1073741824" returned: 0 in 0.053s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Successfully created port: 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Cannot resize image /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Ensure instance console log exists: /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Successfully updated port: 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquired lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-changed-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Refreshing instance network info cache due to event network-changed-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] Acquiring lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:36:39 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.neutron [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Releasing lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Instance network_info: |[{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] Acquired lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Refreshing network info cache for port 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Start _get_guest_xml network_info=[{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:36:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3968363',id=46,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA34lGHn97G74m8glcvcbQ1vJVmJEj+glZ9i+qYhSQqiU3vtGMkrhIFOCnggTeY5+kYNDs6MX0gxBhYOzCJpeCiIaRaU4jf8/NpsgC9a5v6lyiCYKCe6kuwfSJYSJv8qg==',key_name='tempest-keypair-1417356751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa778076f1694362b069beeb0a81a043',ramdisk_id='',reservation_id='r-yzzwca1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b07774ec58e64468bccc87478606eff7',uuid=b5aeb493-ed6e-4a09-a7f6-9f87bd985040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converting VIF {"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.objects.instance [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lazy-loading 'pci_devices' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:36:40 user nova-compute[75051]:   <uuid>b5aeb493-ed6e-4a09-a7f6-9f87bd985040</uuid>
Nov 24 19:36:40 user nova-compute[75051]:   <name>instance-0000002e</name>
Nov 24 19:36:40 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:36:40 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:36:40 user nova-compute[75051]:   <metadata>
Nov 24 19:36:40 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:36:40 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354</nova:name>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:36:40</nova:creationTime>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:36:40 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:36:40 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:owner>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:user uuid="b07774ec58e64468bccc87478606eff7">tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member</nova:user>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:project uuid="aa778076f1694362b069beeb0a81a043">tempest-TestServerVolumeAttachScenarioOldVersion-960432509</nova:project>
Nov 24 19:36:40 user nova-compute[75051]:       </nova:owner>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:36:40 user nova-compute[75051]:       <nova:ports>
Nov 24 19:36:40 user nova-compute[75051]:         <nova:port uuid="49d1ee52-b46a-47b6-8dc3-7bbd34dfe771">
Nov 24 19:36:40 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 24 19:36:40 user nova-compute[75051]:         </nova:port>
Nov 24 19:36:40 user nova-compute[75051]:       </nova:ports>
Nov 24 19:36:40 user nova-compute[75051]:     </nova:instance>
Nov 24 19:36:40 user nova-compute[75051]:   </metadata>
Nov 24 19:36:40 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:36:40 user nova-compute[75051]:     <system>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="serial">b5aeb493-ed6e-4a09-a7f6-9f87bd985040</entry>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="uuid">b5aeb493-ed6e-4a09-a7f6-9f87bd985040</entry>
Nov 24 19:36:40 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:36:40 user nova-compute[75051]:     </system>
Nov 24 19:36:40 user nova-compute[75051]:   </sysinfo>
Nov 24 19:36:40 user nova-compute[75051]:   <os>
Nov 24 19:36:40 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:36:40 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:36:40 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:36:40 user nova-compute[75051]:   </os>
Nov 24 19:36:40 user nova-compute[75051]:   <features>
Nov 24 19:36:40 user nova-compute[75051]:     <acpi/>
Nov 24 19:36:40 user nova-compute[75051]:     <apic/>
Nov 24 19:36:40 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:36:40 user nova-compute[75051]:   </features>
Nov 24 19:36:40 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:36:40 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:36:40 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:36:40 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:36:40 user nova-compute[75051]:   </clock>
Nov 24 19:36:40 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:36:40 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:36:40 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:36:40 user nova-compute[75051]:   </cpu>
Nov 24 19:36:40 user nova-compute[75051]:   <devices>
Nov 24 19:36:40 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:36:40 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:36:40 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk"/>
Nov 24 19:36:40 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:36:40 user nova-compute[75051]:     </disk>
Nov 24 19:36:40 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:36:40 user nova-compute[75051]:       <mac address="fa:16:3e:52:2e:55"/>
Nov 24 19:36:40 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:36:40 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:36:40 user nova-compute[75051]:       <target dev="tap49d1ee52-b4"/>
Nov 24 19:36:40 user nova-compute[75051]:     </interface>
Nov 24 19:36:40 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:36:40 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/console.log" append="off"/>
Nov 24 19:36:40 user nova-compute[75051]:     </serial>
Nov 24 19:36:40 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:36:40 user nova-compute[75051]:     <video>
Nov 24 19:36:40 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:36:40 user nova-compute[75051]:     </video>
Nov 24 19:36:40 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:36:40 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:36:40 user nova-compute[75051]:     </rng>
Nov 24 19:36:40 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:36:40 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:36:40 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:36:40 user nova-compute[75051]:     </memballoon>
Nov 24 19:36:40 user nova-compute[75051]:   </devices>
Nov 24 19:36:40 user nova-compute[75051]: </domain>
Nov 24 19:36:40 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3968363',id=46,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA34lGHn97G74m8glcvcbQ1vJVmJEj+glZ9i+qYhSQqiU3vtGMkrhIFOCnggTeY5+kYNDs6MX0gxBhYOzCJpeCiIaRaU4jf8/NpsgC9a5v6lyiCYKCe6kuwfSJYSJv8qg==',key_name='tempest-keypair-1417356751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa778076f1694362b069beeb0a81a043',ramdisk_id='',reservation_id='r-yzzwca1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b07774ec58e64468bccc87478606eff7',uuid=b5aeb493-ed6e-4a09-a7f6-9f87bd985040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converting VIF {"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG os_vif [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ee226ad-09b2-527f-a3da-102803e99a27', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49d1ee52-b4, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49d1ee52-b4, col_values=(('qos', UUID('1c6f2e0b-27b5-47ea-9b95-6c8f6fb737f0')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49d1ee52-b4, col_values=(('external_ids', {'iface-id': '49d1ee52-b46a-47b6-8dc3-7bbd34dfe771', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:2e:55', 'vm-uuid': 'b5aeb493-ed6e-4a09-a7f6-9f87bd985040'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:40 user nova-compute[75051]: INFO os_vif [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4')
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] No VIF found with MAC fa:16:3e:52:2e:55, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updated VIF entry in instance network info cache for port 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG nova.network.neutron [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:36:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-59a5f2ef-cea3-4516-99d9-3bb9caa608ab req-1c057f0a-2d6c-4de1-a88d-e803ef05a854 service nova] Releasing lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG nova.compute.manager [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] No waiting events found dispatching network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:36:41 user nova-compute[75051]: WARNING nova.compute.manager [req-75c5f099-7d2b-4f18-a689-9bb9bfe16883 req-cbea14e0-c5bb-4b8e-a689-d4d5746b0a4f service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received unexpected event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 for instance with vm_state building and task_state spawning.
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:41 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:36:42 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:42 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=25.203506469726562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bf0e700b-5ed4-4617-9b2c-ece87e8ba039 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:36:42 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:36:43 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Instance spawned successfully.
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] No waiting events found dispatching network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:36:43 user nova-compute[75051]: WARNING nova.compute.manager [req-1900e968-96b0-4d49-8b80-072bc79b4cd9 req-0b96bcee-85b5-439b-bc3a-ea8d2cdf249c service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received unexpected event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 for instance with vm_state building and task_state spawning.
Nov 24 19:36:43 user nova-compute[75051]: INFO nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 24 19:36:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:36:44 user nova-compute[75051]: INFO nova.compute.manager [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Took 5.80 seconds to build instance.
Nov 24 19:36:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-183079f4-0fc1-4323-a977-ee16a7ee77b9 tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.923s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:36:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:44 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:36:48 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid bf0e700b-5ed4-4617-9b2c-ece87e8ba039 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:36:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updating instance_info_cache with network_info: [{"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:36:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-bf0e700b-5ed4-4617-9b2c-ece87e8ba039" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:36:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:36:49 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:36:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:36:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:37:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:37:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:37:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.17462158203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance bf0e700b-5ed4-4617-9b2c-ece87e8ba039 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:37:44 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:37:45 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:37:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:48 user nova-compute[75051]: INFO nova.compute.manager [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Terminating instance
Nov 24 19:37:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-unplugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] No waiting events found dispatching network-vif-unplugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.compute.manager [req-d1c821c9-3398-4283-9868-7cdd952269ce req-85dc4f9d-823b-41cb-8d4b-50da232b5f36 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-unplugged-763549b2-db3b-41ba-8146-15fef7ae2a03 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:37:49 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Instance destroyed successfully.
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid bf0e700b-5ed4-4617-9b2c-ece87e8ba039 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1875855520',display_name='tempest-TestVolumeBootPattern-server-1875855520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1875855520',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:36:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-35re78k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:36:16Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=bf0e700b-5ed4-4617-9b2c-ece87e8ba039,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "763549b2-db3b-41ba-8146-15fef7ae2a03", "address": "fa:16:3e:cb:5c:cf", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763549b2-db", "ovs_interfaceid": "763549b2-db3b-41ba-8146-15fef7ae2a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_vif [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap763549b2-db, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27ab903d-ad51-44c0-bc0f-d519b60dc850) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:49 user nova-compute[75051]: INFO os_vif [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:5c:cf,bridge_name='br-int',has_traffic_filtering=True,id=763549b2-db3b-41ba-8146-15fef7ae2a03,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763549b2-db')
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nVbufarP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:37:49 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5953ad1-bf77-4389-91f2-edbef7e37e50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:37:49 user nova-compute[75051]: No targets found.
Nov 24 19:37:49 user nova-compute[75051]: iSNS:
Nov 24 19:37:49 user nova-compute[75051]: No targets found.
Nov 24 19:37:49 user nova-compute[75051]: STATIC:
Nov 24 19:37:49 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555
Nov 24 19:37:49 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:37:49 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:37:49 user nova-compute[75051]: FIRMWARE:
Nov 24 19:37:49 user nova-compute[75051]: No targets found.
Nov 24 19:37:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:37:49 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:37:49 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903cd0f-d1e1-4ca5-951d-8242c661a74d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde98c9-5ba7-4d23-ac4c-17e4f0e10fc8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)
Nov 24 19:37:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 (non-flash)
Nov 24 19:37:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c04ed5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1481a5-b104-485d-913d-3ea455262245]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff80996-2ad6-4bc6-afc4-c2de3fcbd526]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b04def-a9cd-4fe2-8c51-1a2553a75d75]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.106s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe14fb-ea08-4d4c-a8df-392e1eee1877]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5af777-5c7f-4ec2-b7b5-736fa9a8703e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0130f-5304-435b-ba5d-09ffeaf3c189]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260]
Nov 24 19:37:49 user nova-compute[75051]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555, portal: 172.16.0.220,3260] successful.
Nov 24 19:37:49 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db7ad476-f766-41c1-86c7-7806f0277555 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[758349a3-9865-4923-af7c-516ed2f6265a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:37:49 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (375ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:37:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:37:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Deleting instance files /opt/stack/data/nova/instances/bf0e700b-5ed4-4617-9b2c-ece87e8ba039_del
Nov 24 19:37:50 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Deletion of /opt/stack/data/nova/instances/bf0e700b-5ed4-4617-9b2c-ece87e8ba039_del complete
Nov 24 19:37:50 user nova-compute[75051]: INFO nova.compute.manager [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 24 19:37:50 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:37:50 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:37:50 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:37:50 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:37:50 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Took 0.80 seconds to deallocate network for instance.
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] Acquiring lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] No waiting events found dispatching network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:37:51 user nova-compute[75051]: WARNING nova.compute.manager [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received unexpected event network-vif-plugged-763549b2-db3b-41ba-8146-15fef7ae2a03 for instance with vm_state active and task_state deleting.
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.compute.manager [req-31cd95ac-0a7b-4973-b511-710e6df3fde8 req-a870f8ba-ca4d-4a88-b026-4c5e4089f2d9 service nova] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Received event network-vif-deleted-763549b2-db3b-41ba-8146-15fef7ae2a03 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:37:51 user nova-compute[75051]: INFO nova.compute.manager [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Took 0.75 seconds to detach 1 volumes for instance.
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: bf0e700b-5ed4-4617-9b2c-ece87e8ba039] Deleting volume: db7ad476-f766-41c1-86c7-7806f0277555 {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:51 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance bf0e700b-5ed4-4617-9b2c-ece87e8ba039
Nov 24 19:37:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-81a763b7-953c-40b3-a123-9304e7602647 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "bf0e700b-5ed4-4617-9b2c-ece87e8ba039" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.167s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:37:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:37:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:37:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:37:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:38:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:38:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-changed-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Refreshing instance network info cache due to event network-changed-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] Acquiring lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] Acquired lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:38:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Refreshing network info cache for port 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:38:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updated VIF entry in instance network info cache for port 49d1ee52-b46a-47b6-8dc3-7bbd34dfe771. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:38:30 user nova-compute[75051]: DEBUG nova.network.neutron [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:38:30 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-324bfc68-2c3e-4da1-aa43-2e46580b7b62 req-7f9bf697-18d2-4c7d-b715-59dde001bc35 service nova] Releasing lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lazy-loading 'flavor' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:33 user nova-compute[75051]: INFO nova.compute.manager [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Attaching volume 79256eea-8556-48c2-840b-6b8c00c281de to /dev/vdb
Nov 24 19:38:33 user nova-compute[75051]: DEBUG os_brick.utils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4453f355-d289-486c-8abd-4fc63f4a490c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64896cc-726a-4342-8a0f-6bd3251aedc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57d41f0-fde7-4af6-b569-9b58245beddc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55377fa-ad09-4b3c-a55f-b992b0cec746]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:33 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:38:34 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:38:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b7b83-3fc5-4d1a-9e17-47fd56de1170]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG os_brick.utils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating existing volume attachment record: 339df3d1-3ace-42e2-9a96-660eaf8e8af0 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:38:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:36 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:38:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdDLzlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:38:39 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:38:39 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:38:39 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c781cd-bc83-48c1-836b-3ee04560c9d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:38:39 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d939dc-c66d-4266-a229-53a4a521ce8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de] added
Nov 24 19:38:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d75c0b9-ed98-4ed7-bc8e-2d4100f23a4e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bea201-0e8c-4905-8711-4a20c46d061c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdDLzlB {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PqdDLzlB" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b2ae9d-e4b0-4b45-81a5-dd7dc1e12e91]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PqdDLzlB'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[34653e00-4338-4ac4-9630-95958ccfc102]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bc28d7-97cb-40f3-8cd8-63f5daef4bcd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:38:39 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:38:39 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:38:39 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:38:39 user nova-compute[75051]: 
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3f4da-5af7-4a95-82f5-d058caf5c797]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260]
Nov 24 19:38:39 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260] successful.
Nov 24 19:38:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[48755ca0-ba6b-4491-ab95-1b4d66d70222]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee423378-dd3c-4de9-af24-dd022fe44a66]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:39 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:38:39 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:38:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb28d8b-301b-41e4-b076-216abbb504ad]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdDLzlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23661346661666233', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661346661666233', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lazy-loading 'flavor' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:38:41 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:38:41 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:38:41 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:38:41 user nova-compute[75051]:   <serial>79256eea-8556-48c2-840b-6b8c00c281de</serial>
Nov 24 19:38:41 user nova-compute[75051]: </disk>
Nov 24 19:38:41 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] No VIF found with MAC fa:16:3e:52:2e:55, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:38:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ab1ddd6b-4174-485d-abf6-a01145fb90ef tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.730s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:44 user nova-compute[75051]: INFO nova.compute.manager [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Detaching volume 79256eea-8556-48c2-840b-6b8c00c281de
Nov 24 19:38:44 user nova-compute[75051]: INFO nova.virt.block_device [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Attempting to driver detach volume 79256eea-8556-48c2-840b-6b8c00c281de from mountpoint /dev/vdb
Nov 24 19:38:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Attempting to detach device vdb from instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:38:44 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:38:44 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:38:44 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:38:44 user nova-compute[75051]:   <serial>79256eea-8556-48c2-840b-6b8c00c281de</serial>
Nov 24 19:38:44 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:38:44 user nova-compute[75051]: </disk>
Nov 24 19:38:44 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:38:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Successfully detached device vdb from instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 from the persistent domain config.
Nov 24 19:38:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:38:44 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:38:44 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:38:44 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:38:44 user nova-compute[75051]:   <serial>79256eea-8556-48c2-840b-6b8c00c281de</serial>
Nov 24 19:38:44 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:38:44 user nova-compute[75051]: </disk>
Nov 24 19:38:44 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:38:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:38:45 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:38:46 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:38:46 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.173015594482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:38:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:38:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:38:49 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:38:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [{"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:38:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-b5aeb493-ed6e-4a09-a7f6-9f87bd985040" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:38:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:38:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:38:53 user nova-compute[75051]: INFO nova.compute.claims [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Claim successful on node user
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:38:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:38:53 user nova-compute[75051]: INFO nova.virt.block_device [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Booting with volume b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 at /dev/vda
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.policy [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.utils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bce3ec-b3ca-4462-b55a-b33b4d003248]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4769d9-2b75-4acf-8eef-8817292fab48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6d56d2-f5fd-4f03-b474-a3a02a48c845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229a867-a6be-4316-884a-ad623ec55cff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:38:53 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:38:53 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d337c5-caed-46e8-961f-8415d1ed87a0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG os_brick.utils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:38:53 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating existing volume attachment record: 08a521b5-e134-4600-a3c8-efcbfcdba6b7 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:38:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Successfully created port: 391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:38:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Successfully updated port: 391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-changed-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.compute.manager [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Refreshing instance network info cache due to event network-changed-391ba16a-6ca7-4155-991e-41bbf27065f7. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Instance network_info: |[{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Refreshing network info cache for port 391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updated VIF entry in instance network info cache for port 391ba16a-6ca7-4155-991e-41bbf27065f7. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-105fcd13-2647-431a-9e9e-bad41903bb99 req-714c6bf0-c4e5-49ae-a60c-e46e173b5e1c service nova] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:38:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:38:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:39:02 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Creating image(s)
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Ensure instance console log exists: /opt/stack/data/nova/instances/8f4c1c04-183b-4f92-b853-479c7afe5a06/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Start _get_guest_xml network_info=[{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaHWzBnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f4c1c04-183b-4f92-b853-479c7afe5a06', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 'serial': 'b9accf96-2afe-4c1e-a8a6-eeb53a1ea634'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '08a521b5-e134-4600-a3c8-efcbfcdba6b7', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:39:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:39:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaHWzBnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:39:02 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:39:02 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:39:02 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc6099d-82da-4197-9c6f-dbf25c6d95b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:39:02 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2d860-7869-43be-a5df-8f68f8df4956]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634] added
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3ca5dc-548d-421f-98bb-bedd5b46255e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1748628f-3e6d-4a3b-b6b3-79d8161c608e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GaHWzBnF {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GaHWzBnF" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[475244e0-69c8-4eca-a368-fdd1566f32f0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GaHWzBnF'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe48f25d-a741-49bc-ae6d-62752693ad09]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3651a4d-7216-4004-be5e-5313bbcd3a6d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[942425eb-4513-4ffd-aac5-2fe2e268d1d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260]
Nov 24 19:39:02 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260] successful.
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae34d73-7ddf-4235-9e7b-deaecb5e3130]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e246e9-d794-4f52-8ad8-d52e1a27759d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:02 user nova-compute[75051]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:02 user nova-compute[75051]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:39:02 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[77180374-4ce8-4201-b1cb-77546ade317b]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:02 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaHWzBnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23534376230643637', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534376230643637', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-892612433',display_name='tempest-TestVolumeBootPattern-volume-backed-server-892612433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-892612433',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzdsBNkzSNPGbW4lbC8Bk/dMpTiy1zjiXqU4VvHdQ5Y+evT18ZsD4gg1QoL+jw3R7Jn/uS0BVSxEUSKXTlaJSsgshIPD+6p7x7bmjTkSbpqk7giGe7mi2uU7R3QKZtcyA==',key_name='tempest-keypair-550381502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-znohvxka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=8f4c1c04-183b-4f92-b853-479c7afe5a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:39:03 user nova-compute[75051]:   <uuid>8f4c1c04-183b-4f92-b853-479c7afe5a06</uuid>
Nov 24 19:39:03 user nova-compute[75051]:   <name>instance-0000002f</name>
Nov 24 19:39:03 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:39:03 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:39:03 user nova-compute[75051]:   <metadata>
Nov 24 19:39:03 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:39:03 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:39:03 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-892612433</nova:name>
Nov 24 19:39:03 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:39:02</nova:creationTime>
Nov 24 19:39:03 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:39:03 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:39:03 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:39:03 user nova-compute[75051]:       <nova:owner>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:39:03 user nova-compute[75051]:       </nova:owner>
Nov 24 19:39:03 user nova-compute[75051]:       <nova:ports>
Nov 24 19:39:03 user nova-compute[75051]:         <nova:port uuid="391ba16a-6ca7-4155-991e-41bbf27065f7">
Nov 24 19:39:03 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 24 19:39:03 user nova-compute[75051]:         </nova:port>
Nov 24 19:39:03 user nova-compute[75051]:       </nova:ports>
Nov 24 19:39:03 user nova-compute[75051]:     </nova:instance>
Nov 24 19:39:03 user nova-compute[75051]:   </metadata>
Nov 24 19:39:03 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:39:03 user nova-compute[75051]:     <system>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="serial">8f4c1c04-183b-4f92-b853-479c7afe5a06</entry>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="uuid">8f4c1c04-183b-4f92-b853-479c7afe5a06</entry>
Nov 24 19:39:03 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:39:03 user nova-compute[75051]:     </system>
Nov 24 19:39:03 user nova-compute[75051]:   </sysinfo>
Nov 24 19:39:03 user nova-compute[75051]:   <os>
Nov 24 19:39:03 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:39:03 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:39:03 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:39:03 user nova-compute[75051]:   </os>
Nov 24 19:39:03 user nova-compute[75051]:   <features>
Nov 24 19:39:03 user nova-compute[75051]:     <acpi/>
Nov 24 19:39:03 user nova-compute[75051]:     <apic/>
Nov 24 19:39:03 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:39:03 user nova-compute[75051]:   </features>
Nov 24 19:39:03 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:39:03 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:39:03 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:39:03 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:39:03 user nova-compute[75051]:   </clock>
Nov 24 19:39:03 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:39:03 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:39:03 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:39:03 user nova-compute[75051]:   </cpu>
Nov 24 19:39:03 user nova-compute[75051]:   <devices>
Nov 24 19:39:03 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:39:03 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:39:03 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:39:03 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:39:03 user nova-compute[75051]:       <serial>b9accf96-2afe-4c1e-a8a6-eeb53a1ea634</serial>
Nov 24 19:39:03 user nova-compute[75051]:     </disk>
Nov 24 19:39:03 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:39:03 user nova-compute[75051]:       <mac address="fa:16:3e:b6:1e:dd"/>
Nov 24 19:39:03 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:39:03 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:39:03 user nova-compute[75051]:       <target dev="tap391ba16a-6c"/>
Nov 24 19:39:03 user nova-compute[75051]:     </interface>
Nov 24 19:39:03 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:39:03 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/8f4c1c04-183b-4f92-b853-479c7afe5a06/console.log" append="off"/>
Nov 24 19:39:03 user nova-compute[75051]:     </serial>
Nov 24 19:39:03 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:39:03 user nova-compute[75051]:     <video>
Nov 24 19:39:03 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:39:03 user nova-compute[75051]:     </video>
Nov 24 19:39:03 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:39:03 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:39:03 user nova-compute[75051]:     </rng>
Nov 24 19:39:03 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:39:03 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:39:03 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:39:03 user nova-compute[75051]:     </memballoon>
Nov 24 19:39:03 user nova-compute[75051]:   </devices>
Nov 24 19:39:03 user nova-compute[75051]: </domain>
Nov 24 19:39:03 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-892612433',display_name='tempest-TestVolumeBootPattern-volume-backed-server-892612433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-892612433',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzdsBNkzSNPGbW4lbC8Bk/dMpTiy1zjiXqU4VvHdQ5Y+evT18ZsD4gg1QoL+jw3R7Jn/uS0BVSxEUSKXTlaJSsgshIPD+6p7x7bmjTkSbpqk7giGe7mi2uU7R3QKZtcyA==',key_name='tempest-keypair-550381502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-znohvxka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=8f4c1c04-183b-4f92-b853-479c7afe5a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG os_vif [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7f111b4-cca5-5554-8e86-93b24ed4592e', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap391ba16a-6c, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap391ba16a-6c, col_values=(('qos', UUID('1fba6534-71e5-401f-b581-522f4e97f296')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap391ba16a-6c, col_values=(('external_ids', {'iface-id': '391ba16a-6ca7-4155-991e-41bbf27065f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:1e:dd', 'vm-uuid': '8f4c1c04-183b-4f92-b853-479c7afe5a06'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:03 user nova-compute[75051]: INFO os_vif [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c')
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:b6:1e:dd, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:39:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:04 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 is timed out.
Nov 24 19:39:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Successfully detached device vdb from instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040 from the live domain config.
Nov 24 19:39:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PqdDLzlB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:39:04 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64104c-f1b1-4b07-8797-0b6560d217a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:39:04 user nova-compute[75051]: No targets found.
Nov 24 19:39:04 user nova-compute[75051]: iSNS:
Nov 24 19:39:04 user nova-compute[75051]: No targets found.
Nov 24 19:39:04 user nova-compute[75051]: STATIC:
Nov 24 19:39:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de
Nov 24 19:39:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:39:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:39:04 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634
Nov 24 19:39:04 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:39:04 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:39:04 user nova-compute[75051]: FIRMWARE:
Nov 24 19:39:04 user nova-compute[75051]: No targets found.
Nov 24 19:39:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:39:04 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:39:04 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[742040f4-36c5-484a-8188-3487f1323f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3bc757-c23a-47a2-be1f-ffb40bd0d586]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:04 user nova-compute[75051]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:39:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de (non-flash)
Nov 24 19:39:04 user nova-compute[75051]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:39:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0427760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04531d6-b093-4670-b6b6-d17b34ae31e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecef708-ff5d-4464-93c4-8f66e2d4bff2]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9994935-4022-4020-b6dc-d745a8822965]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cc4acf-99c8-4eba-a4b2-86133cc16358]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29ebb5-6184-4678-b1a9-1692d9695ac8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[320c01aa-cbaa-42a8-93be-69822fc82c35]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260]
Nov 24 19:39:04 user nova-compute[75051]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de, portal: 172.16.0.220,3260] successful.
Nov 24 19:39:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79256eea-8556-48c2-840b-6b8c00c281de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a01fa-0828-4503-a3c3-84f353c7bea5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] <== disconnect_volume: return (304ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:39:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG nova.compute.manager [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:39:05 user nova-compute[75051]: WARNING nova.compute.manager [req-913e4287-fd2c-40b2-b75b-d3d02d577003 req-2ffd1b40-a567-4116-ba10-c3cc9763725a service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state building and task_state spawning.
Nov 24 19:39:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lazy-loading 'flavor' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:39:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-3229da8f-b5bd-4459-88c9-5f7c7924b88e tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:39:06 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Instance spawned successfully.
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:06 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:39:07 user nova-compute[75051]: INFO nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 24 19:39:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:39:07 user nova-compute[75051]: INFO nova.compute.manager [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Took 13.80 seconds to build instance.
Nov 24 19:39:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d11c4767-382f-42c2-aeb0-5dd8459b1f99 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.892s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:39:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:39:07 user nova-compute[75051]: WARNING nova.compute.manager [req-39135ce3-8132-4830-add9-784190c71d8e req-b0341d3b-c721-4d1b-bef1-c45df1686dab service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state active and task_state None.
Nov 24 19:39:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:39:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:39:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:37 user nova-compute[75051]: INFO nova.compute.manager [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Terminating instance
Nov 24 19:39:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-unplugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] No waiting events found dispatching network-vif-unplugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-ba473cb2-cc91-44c4-8d51-9817564c5522 req-8aeef72e-82f6-4ab7-84fb-4fd2e9ff7cd2 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-unplugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Instance destroyed successfully.
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.objects.instance [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lazy-loading 'resources' on Instance uuid b5aeb493-ed6e-4a09-a7f6-9f87bd985040 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-396836354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3968363',id=46,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA34lGHn97G74m8glcvcbQ1vJVmJEj+glZ9i+qYhSQqiU3vtGMkrhIFOCnggTeY5+kYNDs6MX0gxBhYOzCJpeCiIaRaU4jf8/NpsgC9a5v6lyiCYKCe6kuwfSJYSJv8qg==',key_name='tempest-keypair-1417356751',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:36:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa778076f1694362b069beeb0a81a043',ramdisk_id='',reservation_id='r-yzzwca1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:36:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b07774ec58e64468bccc87478606eff7',uuid=b5aeb493-ed6e-4a09-a7f6-9f87bd985040,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converting VIF {"id": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "address": "fa:16:3e:52:2e:55", "network": {"id": "92ab985d-9822-4139-89d0-fa241cd72670", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-537336115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa778076f1694362b069beeb0a81a043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49d1ee52-b4", "ovs_interfaceid": "49d1ee52-b46a-47b6-8dc3-7bbd34dfe771", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG os_vif [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49d1ee52-b4, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c6f2e0b-27b5-47ea-9b95-6c8f6fb737f0) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:38 user nova-compute[75051]: INFO os_vif [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=49d1ee52-b46a-47b6-8dc3-7bbd34dfe771,network=Network(92ab985d-9822-4139-89d0-fa241cd72670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49d1ee52-b4')
Nov 24 19:39:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Deleting instance files /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040_del
Nov 24 19:39:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Deletion of /opt/stack/data/nova/instances/b5aeb493-ed6e-4a09-a7f6-9f87bd985040_del complete
Nov 24 19:39:38 user nova-compute[75051]: INFO nova.compute.manager [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 24 19:39:38 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:39:39 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Took 0.85 seconds to deallocate network for instance.
Nov 24 19:39:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-e33b8e28-c373-4996-9769-9210d0a183e4 req-12e88baf-704e-45ff-b6cb-10f3b8b8bf59 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-deleted-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:39:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:39 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Deleted allocations for instance b5aeb493-ed6e-4a09-a7f6-9f87bd985040
Nov 24 19:39:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-5d380107-de8a-4e27-a98a-0a61b56fe84f tempest-TestServerVolumeAttachScenarioOldVersion-960432509 tempest-TestServerVolumeAttachScenarioOldVersion-960432509-project-member] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:39:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] Acquiring lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] Lock "b5aeb493-ed6e-4a09-a7f6-9f87bd985040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:40 user nova-compute[75051]: DEBUG nova.compute.manager [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] No waiting events found dispatching network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:39:40 user nova-compute[75051]: WARNING nova.compute.manager [req-db177b10-8674-4045-8951-541cb2b40aab req-391b38f9-9cd6-47c4-8ecf-54eb903b3de5 service nova] [instance: b5aeb493-ed6e-4a09-a7f6-9f87bd985040] Received unexpected event network-vif-plugged-49d1ee52-b46a-47b6-8dc3-7bbd34dfe771 for instance with vm_state deleted and task_state None.
Nov 24 19:39:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:46 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:39:47 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:39:47 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8915MB free_disk=25.19097900390625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 8f4c1c04-183b-4f92-b853-479c7afe5a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:39:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:39:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:39:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:39:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:39:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:39:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:40:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:39 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:40:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-changed-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Refreshing instance network info cache due to event network-changed-391ba16a-6ca7-4155-991e-41bbf27065f7. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Refreshing network info cache for port 391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updated VIF entry in instance network info cache for port 391ba16a-6ca7-4155-991e-41bbf27065f7. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c0594b37-7c0d-4bff-b608-5293c973530b req-70e6305d-cc39-47f2-964b-fd40ba7a2053 service nova] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:40:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:40:49 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:40:49 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.188884735107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 8f4c1c04-183b-4f92-b853-479c7afe5a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:40:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:40:50 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:51 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:40:51 user nova-compute[75051]: INFO nova.compute.claims [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Claim successful on node user
Nov 24 19:40:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:40:52 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:40:52 user nova-compute[75051]: INFO nova.virt.block_device [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Booting with volume snapshot d7d76809-6fcf-47ce-b3a0-e6be2f43dccf at /dev/vda
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.policy [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:40:52 user nova-compute[75051]: INFO nova.compute.claims [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Claim successful on node user
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Successfully created port: 4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.269s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:40:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:40:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.policy [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9d99c1975094995b38566872a5f6540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3850bca8c6341ad82ff8b0e86297ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:40:53 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Creating image(s)
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "/opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "/opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.242s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Successfully updated port: 4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-changed-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Refreshing instance network info cache due to event network-changed-4e979ac6-7590-489a-9b38-bb5a88a85073. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] Acquiring lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Successfully created port: b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.224s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk 1073741824" returned: 0 in 0.054s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:53 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.190s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updating instance_info_cache with network_info: [{"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Instance network_info: |[{"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] Acquired lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Refreshing network info cache for port 4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Cannot resize image /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Ensure instance console log exists: /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Successfully updated port: b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquired lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-changed-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.compute.manager [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Refreshing instance network info cache due to event network-changed-b8e8f64c-e74d-4f63-9dfd-85596766f698. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] Acquiring lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updated VIF entry in instance network info cache for port 4e979ac6-7590-489a-9b38-bb5a88a85073. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updating instance_info_cache with network_info: [{"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b8d0e9-8438-447b-bb1d-14c223dbe755 req-d68a8a0f-2588-48d7-afc5-e2baeb4db14c service nova] Releasing lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Releasing lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Instance network_info: |[{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] Acquired lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.neutron [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Refreshing network info cache for port b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Start _get_guest_xml network_info=[{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:40:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:40:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1262145732',display_name='tempest-TestServerVolumeAttachmentScenario-server-1262145732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1262145732',id=49,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaS7a6SgYc29rdWHg0273XQNEcW/3X7Y2p3f8FnFfBFfd/BNZJg3dJG1m7j1XpEfqemdX69w8+CIMZkA7kq9JgzHQkXX4jfRMl/5KjEUNhtXsryHwC/C+1A8Chmtu+Ozg==',key_name='tempest-keypair-177155023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3850bca8c6341ad82ff8b0e86297ec8',ramdisk_id='',reservation_id='r-rerm4yes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-586057998',owner_user_name='tempest-TestServerVolumeAttachmentScenario-586057998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9d99c1975094995b38566872a5f6540',uuid=f1285495-56f1-4d11-bde0-0271a057a92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converting VIF {"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.objects.instance [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'pci_devices' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:40:54 user nova-compute[75051]:   <uuid>f1285495-56f1-4d11-bde0-0271a057a92c</uuid>
Nov 24 19:40:54 user nova-compute[75051]:   <name>instance-00000031</name>
Nov 24 19:40:54 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:40:54 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:40:54 user nova-compute[75051]:   <metadata>
Nov 24 19:40:54 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:40:54 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1262145732</nova:name>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:40:54</nova:creationTime>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:40:54 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:40:54 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:owner>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:user uuid="d9d99c1975094995b38566872a5f6540">tempest-TestServerVolumeAttachmentScenario-586057998-project-member</nova:user>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:project uuid="f3850bca8c6341ad82ff8b0e86297ec8">tempest-TestServerVolumeAttachmentScenario-586057998</nova:project>
Nov 24 19:40:54 user nova-compute[75051]:       </nova:owner>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:40:54 user nova-compute[75051]:       <nova:ports>
Nov 24 19:40:54 user nova-compute[75051]:         <nova:port uuid="b8e8f64c-e74d-4f63-9dfd-85596766f698">
Nov 24 19:40:54 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 19:40:54 user nova-compute[75051]:         </nova:port>
Nov 24 19:40:54 user nova-compute[75051]:       </nova:ports>
Nov 24 19:40:54 user nova-compute[75051]:     </nova:instance>
Nov 24 19:40:54 user nova-compute[75051]:   </metadata>
Nov 24 19:40:54 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:40:54 user nova-compute[75051]:     <system>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="serial">f1285495-56f1-4d11-bde0-0271a057a92c</entry>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="uuid">f1285495-56f1-4d11-bde0-0271a057a92c</entry>
Nov 24 19:40:54 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:40:54 user nova-compute[75051]:     </system>
Nov 24 19:40:54 user nova-compute[75051]:   </sysinfo>
Nov 24 19:40:54 user nova-compute[75051]:   <os>
Nov 24 19:40:54 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:40:54 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:40:54 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:40:54 user nova-compute[75051]:   </os>
Nov 24 19:40:54 user nova-compute[75051]:   <features>
Nov 24 19:40:54 user nova-compute[75051]:     <acpi/>
Nov 24 19:40:54 user nova-compute[75051]:     <apic/>
Nov 24 19:40:54 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:40:54 user nova-compute[75051]:   </features>
Nov 24 19:40:54 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:40:54 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:40:54 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:40:54 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:40:54 user nova-compute[75051]:   </clock>
Nov 24 19:40:54 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:40:54 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:40:54 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:40:54 user nova-compute[75051]:   </cpu>
Nov 24 19:40:54 user nova-compute[75051]:   <devices>
Nov 24 19:40:54 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:40:54 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:40:54 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk"/>
Nov 24 19:40:54 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:40:54 user nova-compute[75051]:     </disk>
Nov 24 19:40:54 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:40:54 user nova-compute[75051]:       <mac address="fa:16:3e:73:a2:29"/>
Nov 24 19:40:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:40:54 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:40:54 user nova-compute[75051]:       <target dev="tapb8e8f64c-e7"/>
Nov 24 19:40:54 user nova-compute[75051]:     </interface>
Nov 24 19:40:54 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:40:54 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/console.log" append="off"/>
Nov 24 19:40:54 user nova-compute[75051]:     </serial>
Nov 24 19:40:54 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:40:54 user nova-compute[75051]:     <video>
Nov 24 19:40:54 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:40:54 user nova-compute[75051]:     </video>
Nov 24 19:40:54 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:40:54 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:40:54 user nova-compute[75051]:     </rng>
Nov 24 19:40:54 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:40:54 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:40:54 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:40:54 user nova-compute[75051]:     </memballoon>
Nov 24 19:40:54 user nova-compute[75051]:   </devices>
Nov 24 19:40:54 user nova-compute[75051]: </domain>
Nov 24 19:40:54 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1262145732',display_name='tempest-TestServerVolumeAttachmentScenario-server-1262145732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1262145732',id=49,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaS7a6SgYc29rdWHg0273XQNEcW/3X7Y2p3f8FnFfBFfd/BNZJg3dJG1m7j1XpEfqemdX69w8+CIMZkA7kq9JgzHQkXX4jfRMl/5KjEUNhtXsryHwC/C+1A8Chmtu+Ozg==',key_name='tempest-keypair-177155023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3850bca8c6341ad82ff8b0e86297ec8',ramdisk_id='',reservation_id='r-rerm4yes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-586057998',owner_user_name='tempest-TestServerVolumeAttachmentScenario-586057998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9d99c1975094995b38566872a5f6540',uuid=f1285495-56f1-4d11-bde0-0271a057a92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converting VIF {"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG os_vif [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c5ed9e8-863b-5eed-8776-696c4144fb81', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8e8f64c-e7, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8e8f64c-e7, col_values=(('qos', UUID('88fda98e-1b87-419c-a381-cac04c891f21')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8e8f64c-e7, col_values=(('external_ids', {'iface-id': 'b8e8f64c-e74d-4f63-9dfd-85596766f698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:a2:29', 'vm-uuid': 'f1285495-56f1-4d11-bde0-0271a057a92c'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:54 user nova-compute[75051]: INFO os_vif [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7')
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:40:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No VIF found with MAC fa:16:3e:73:a2:29, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:40:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updated VIF entry in instance network info cache for port b8e8f64c-e74d-4f63-9dfd-85596766f698. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:40:55 user nova-compute[75051]: DEBUG nova.network.neutron [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:40:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-964ea3c0-7232-486e-82df-194efaeac322 req-c991b397-d4d5-4fb9-ba65-441bc5ba3a81 service nova] Releasing lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG nova.compute.manager [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:40:56 user nova-compute[75051]: WARNING nova.compute.manager [req-bf57e38c-3c6d-484a-856e-25987fd53eb3 req-8b8887eb-795e-4d34-94e4-132e2c9de9fa service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state building and task_state spawning.
Nov 24 19:40:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG os_brick.utils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c9785-d274-4bc7-95c6-fe5e16b4a25a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086c286-3844-4565-82c9-b5ca391adcac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e6fdaf-46e8-4783-a341-890d4525a3cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f1d6a8-e3de-4c94-9199-786e7d36bbad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:40:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:40:58 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3cea9a-60da-451e-bb72-3e2676ea095f]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG os_brick.utils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updating existing volume attachment record: a4acac6a-7bce-4272-9c75-bc69cf8be51d {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:40:58 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Instance spawned successfully.
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.compute.manager [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:40:58 user nova-compute[75051]: WARNING nova.compute.manager [req-c060054a-5880-41f0-8506-289f24815235 req-c1e9276d-7a4d-4a0e-a9f3-cc1c09e59945 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state building and task_state spawning.
Nov 24 19:40:58 user nova-compute[75051]: INFO nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 24 19:40:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:40:58 user nova-compute[75051]: INFO nova.compute.manager [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Took 5.82 seconds to build instance.
Nov 24 19:40:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-77a7ce02-6882-4a46-a9b7-9e966f436ec5 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.909s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:40:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:41:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Creating image(s)
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Ensure instance console log exists: /opt/stack/data/nova/instances/373112f3-6b78-44fe-9a02-5fd44e652cf2/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Start _get_guest_xml network_info=[{"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-24T19:40:46Z,direct_url=<?>,disk_format='qcow2',id=53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1404864216',owner='bad94fcdfedd4a2a930e0622ea9b6b5a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-24T19:40:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJgIavEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '373112f3-6b78-44fe-9a02-5fd44e652cf2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7c86f16-78da-405d-9e3c-65b499e8c9a6', 'serial': 'a7c86f16-78da-405d-9e3c-65b499e8c9a6'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a4acac6a-7bce-4272-9c75-bc69cf8be51d', 'boot_index': 0, 'delete_on_termination': True, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:41:04 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:41:04 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-24T19:40:46Z,direct_url=<?>,disk_format='qcow2',id=53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1404864216',owner='bad94fcdfedd4a2a930e0622ea9b6b5a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-24T19:40:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJgIavEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:41:04 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:41:04 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:41:04 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f7e644-dc9b-4b02-8a81-8dca49e5bd5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:41:04 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53adb6b-0346-4ecc-9231-6f4c727460c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6] added
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5814e-236d-4780-8d6c-39454aa25b3a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f7ca0c-de7a-4da0-9f1d-49bd7bec473d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJgIavEm {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MJgIavEm" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b60851-6321-4725-89a0-a306446df522]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MJgIavEm'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7890c-6e0c-4ef7-be70-c244dce76250]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[032fa6e3-c04c-4b84-b1f4-1f3015252b20]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[745fccab-9e10-453e-95b8-99729ad58d9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260]
Nov 24 19:41:04 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260] successful.
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2111b45-a6ec-48e5-ae3a-c0bb31c2f72a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad7405b-494d-4493-9f57-188b4e6be0bf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)
Nov 24 19:41:04 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21bce16-e295-4020-9608-3aef7b26af80]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJgIavEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:41:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23430623930616461', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430623930616461', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-934146577',id=48,image_ref='53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJap1/rn+2gMpBN04Buu6RylA+frVkSTjFaS2MZH84tTuSURfz8g6fa6oXyf8dtHL1okENqIyIpVuiLKTQEpkau1DmtJxHJlCaO4vw2uxEuUGf0GMIZ2MJh//XPf9hnw4Q==',key_name='tempest-keypair-1494293540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-0vq4i3xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-164541672',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=373112f3-6b78-44fe-9a02-5fd44e652cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid 373112f3-6b78-44fe-9a02-5fd44e652cf2 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:41:05 user nova-compute[75051]:   <uuid>373112f3-6b78-44fe-9a02-5fd44e652cf2</uuid>
Nov 24 19:41:05 user nova-compute[75051]:   <name>instance-00000030</name>
Nov 24 19:41:05 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:41:05 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:41:05 user nova-compute[75051]:   <metadata>
Nov 24 19:41:05 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:41:05 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-934146577</nova:name>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:41:04</nova:creationTime>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:41:05 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:41:05 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:owner>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:41:05 user nova-compute[75051]:       </nova:owner>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:root type="image" uuid="53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21"/>
Nov 24 19:41:05 user nova-compute[75051]:       <nova:ports>
Nov 24 19:41:05 user nova-compute[75051]:         <nova:port uuid="4e979ac6-7590-489a-9b38-bb5a88a85073">
Nov 24 19:41:05 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 24 19:41:05 user nova-compute[75051]:         </nova:port>
Nov 24 19:41:05 user nova-compute[75051]:       </nova:ports>
Nov 24 19:41:05 user nova-compute[75051]:     </nova:instance>
Nov 24 19:41:05 user nova-compute[75051]:   </metadata>
Nov 24 19:41:05 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:41:05 user nova-compute[75051]:     <system>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="serial">373112f3-6b78-44fe-9a02-5fd44e652cf2</entry>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="uuid">373112f3-6b78-44fe-9a02-5fd44e652cf2</entry>
Nov 24 19:41:05 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:41:05 user nova-compute[75051]:     </system>
Nov 24 19:41:05 user nova-compute[75051]:   </sysinfo>
Nov 24 19:41:05 user nova-compute[75051]:   <os>
Nov 24 19:41:05 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:41:05 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:41:05 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:41:05 user nova-compute[75051]:   </os>
Nov 24 19:41:05 user nova-compute[75051]:   <features>
Nov 24 19:41:05 user nova-compute[75051]:     <acpi/>
Nov 24 19:41:05 user nova-compute[75051]:     <apic/>
Nov 24 19:41:05 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:41:05 user nova-compute[75051]:   </features>
Nov 24 19:41:05 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:41:05 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:41:05 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:41:05 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:41:05 user nova-compute[75051]:   </clock>
Nov 24 19:41:05 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:41:05 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:41:05 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:41:05 user nova-compute[75051]:   </cpu>
Nov 24 19:41:05 user nova-compute[75051]:   <devices>
Nov 24 19:41:05 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:41:05 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:41:05 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 19:41:05 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:41:05 user nova-compute[75051]:       <serial>a7c86f16-78da-405d-9e3c-65b499e8c9a6</serial>
Nov 24 19:41:05 user nova-compute[75051]:     </disk>
Nov 24 19:41:05 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:41:05 user nova-compute[75051]:       <mac address="fa:16:3e:28:e3:f0"/>
Nov 24 19:41:05 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:41:05 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:41:05 user nova-compute[75051]:       <target dev="tap4e979ac6-75"/>
Nov 24 19:41:05 user nova-compute[75051]:     </interface>
Nov 24 19:41:05 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:41:05 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/373112f3-6b78-44fe-9a02-5fd44e652cf2/console.log" append="off"/>
Nov 24 19:41:05 user nova-compute[75051]:     </serial>
Nov 24 19:41:05 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:41:05 user nova-compute[75051]:     <video>
Nov 24 19:41:05 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:41:05 user nova-compute[75051]:     </video>
Nov 24 19:41:05 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:41:05 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:41:05 user nova-compute[75051]:     </rng>
Nov 24 19:41:05 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:41:05 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:41:05 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:41:05 user nova-compute[75051]:     </memballoon>
Nov 24 19:41:05 user nova-compute[75051]:   </devices>
Nov 24 19:41:05 user nova-compute[75051]: </domain>
Nov 24 19:41:05 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-934146577',id=48,image_ref='53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJap1/rn+2gMpBN04Buu6RylA+frVkSTjFaS2MZH84tTuSURfz8g6fa6oXyf8dtHL1okENqIyIpVuiLKTQEpkau1DmtJxHJlCaO4vw2uxEuUGf0GMIZ2MJh//XPf9hnw4Q==',key_name='tempest-keypair-1494293540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-0vq4i3xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-164541672',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=373112f3-6b78-44fe-9a02-5fd44e652cf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG os_vif [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11a1e40d-01b7-5e6b-9ab9-b583acee0d11', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e979ac6-75, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e979ac6-75, col_values=(('qos', UUID('034bc9c5-4456-4510-91d2-2cfc394e9354')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e979ac6-75, col_values=(('external_ids', {'iface-id': '4e979ac6-7590-489a-9b38-bb5a88a85073', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:e3:f0', 'vm-uuid': '373112f3-6b78-44fe-9a02-5fd44e652cf2'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:05 user nova-compute[75051]: INFO os_vif [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75')
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:41:05 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:28:e3:f0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG nova.compute.manager [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] No waiting events found dispatching network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:41:07 user nova-compute[75051]: WARNING nova.compute.manager [req-eeb6809b-d156-46e6-bd5a-fb6d7dc8454d req-e0e67c5d-810a-4d16-93af-4dd5775b6fa3 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received unexpected event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 for instance with vm_state building and task_state spawning.
Nov 24 19:41:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:41:09 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Instance spawned successfully.
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:41:09 user nova-compute[75051]: INFO nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:41:09 user nova-compute[75051]: INFO nova.compute.manager [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Took 17.42 seconds to build instance.
Nov 24 19:41:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-faf1f4e8-4534-4492-a314-3e8058e5794d tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.533s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:09 user nova-compute[75051]: DEBUG nova.compute.manager [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] No waiting events found dispatching network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:41:09 user nova-compute[75051]: WARNING nova.compute.manager [req-497a58a6-e1b7-41e6-96e7-ef6645a9a654 req-e57d3e7e-9ce7-4c68-b55f-42b9cb3172aa service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received unexpected event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 for instance with vm_state active and task_state None.
Nov 24 19:41:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:40 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:40 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:41:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:48 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:41:49 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:41:49 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8694MB free_disk=25.150131225585938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 8f4c1c04-183b-4f92-b853-479c7afe5a06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 373112f3-6b78-44fe-9a02-5fd44e652cf2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f1285495-56f1-4d11-bde0-0271a057a92c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:41:49 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:41:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:41:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:41:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [{"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-8f4c1c04-183b-4f92-b853-479c7afe5a06" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:41:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:42:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-changed-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG nova.compute.manager [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Refreshing instance network info cache due to event network-changed-4e979ac6-7590-489a-9b38-bb5a88a85073. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] Acquiring lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] Acquired lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG nova.network.neutron [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Refreshing network info cache for port 4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updated VIF entry in instance network info cache for port 4e979ac6-7590-489a-9b38-bb5a88a85073. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updating instance_info_cache with network_info: [{"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f129af1c-31fa-43ca-b7d7-85a4d7a6826f req-b4e304bd-7bed-4c5a-8137-eab7ded625b5 service nova] Releasing lock "refresh_cache-373112f3-6b78-44fe-9a02-5fd44e652cf2" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:43 user nova-compute[75051]: INFO nova.compute.manager [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Terminating instance
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-changed-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.compute.manager [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Refreshing instance network info cache due to event network-changed-b8e8f64c-e74d-4f63-9dfd-85596766f698. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] Acquiring lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] Acquired lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:42:43 user nova-compute[75051]: DEBUG nova.network.neutron [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Refreshing network info cache for port b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:42:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Instance destroyed successfully.
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid 373112f3-6b78-44fe-9a02-5fd44e652cf2 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-934146577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-934146577',id=48,image_ref='53c64f65-dd0e-4d9a-b4d6-96ebc30b1f21',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJap1/rn+2gMpBN04Buu6RylA+frVkSTjFaS2MZH84tTuSURfz8g6fa6oXyf8dtHL1okENqIyIpVuiLKTQEpkau1DmtJxHJlCaO4vw2uxEuUGf0GMIZ2MJh//XPf9hnw4Q==',key_name='tempest-keypair-1494293540',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:41:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-0vq4i3xg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-164541672',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:41:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=373112f3-6b78-44fe-9a02-5fd44e652cf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "4e979ac6-7590-489a-9b38-bb5a88a85073", "address": "fa:16:3e:28:e3:f0", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e979ac6-75", "ovs_interfaceid": "4e979ac6-7590-489a-9b38-bb5a88a85073", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_vif [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e979ac6-75, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=034bc9c5-4456-4510-91d2-2cfc394e9354) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:44 user nova-compute[75051]: INFO os_vif [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:e3:f0,bridge_name='br-int',has_traffic_filtering=True,id=4e979ac6-7590-489a-9b38-bb5a88a85073,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e979ac6-75')
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MJgIavEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:42:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b0f9d-a4f6-4fde-b34c-589314eb596f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:42:44 user nova-compute[75051]: No targets found.
Nov 24 19:42:44 user nova-compute[75051]: iSNS:
Nov 24 19:42:44 user nova-compute[75051]: No targets found.
Nov 24 19:42:44 user nova-compute[75051]: STATIC:
Nov 24 19:42:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6
Nov 24 19:42:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:42:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:42:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634
Nov 24 19:42:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:42:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:42:44 user nova-compute[75051]: FIRMWARE:
Nov 24 19:42:44 user nova-compute[75051]: No targets found.
Nov 24 19:42:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:42:44 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:42:44 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40919da-07a8-4e39-847f-670c1bd55c20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c4b7b4-d68e-444d-b653-aa717a4cd112]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:44 user nova-compute[75051]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)
Nov 24 19:42:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:44 user nova-compute[75051]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 (non-flash)
Nov 24 19:42:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a042b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0a48d4-d0c3-437a-ae2c-cbaf34ab2ddc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97d1676-78e5-4206-bb7c-43e600b20f37]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c6d39-35de-42fb-b800-6ac11f13ead9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4255f1-7504-4146-aeda-080d2de39eb1]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_895d8337', '/dev/disk/by-id/scsi-1SCST_BIO895d8337-40b90ada4e6f0b79', '/dev/disk/by-id/scsi-23430623930616461') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee54745-7676-4016-8ac2-33eddb39933c]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0396b-bd06-4343-a02d-aee2c5b756c4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac60e6ec-ef78-45f4-9830-1c61cacb24b7]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260]
Nov 24 19:42:44 user nova-compute[75051]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6, portal: 172.16.0.220,3260] successful.
Nov 24 19:42:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7c86f16-78da-405d-9e3c-65b499e8c9a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca600fcb-6bba-4cc7-8aae-e30668da3716]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (321ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:42:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Deleting instance files /opt/stack/data/nova/instances/373112f3-6b78-44fe-9a02-5fd44e652cf2_del
Nov 24 19:42:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Deletion of /opt/stack/data/nova/instances/373112f3-6b78-44fe-9a02-5fd44e652cf2_del complete
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:44 user nova-compute[75051]: INFO nova.compute.manager [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:44 user nova-compute[75051]: INFO nova.compute.manager [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attaching volume de71d7fa-61d9-4ebc-8a5d-b8747efb82ab to /dev/vdb
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updated VIF entry in instance network info cache for port b8e8f64c-e74d-4f63-9dfd-85596766f698. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.network.neutron [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.utils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d99b4ea3-8aeb-4ed8-b16f-847392e7a5f0 req-bae44fd3-8208-41be-a01a-97876a188af3 service nova] Releasing lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f53a19-db83-4782-9cf6-f22047a53112]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77737fb-2fd1-415b-a474-dc48b15325a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3dd2ae-f737-4bfc-9a0b-d81711e277d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fec9ee-1f0f-4fc7-bbd8-45da420f8471]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:42:44 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bf82aa-a617-40ca-8e07-082feaf5ac33]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG os_brick.utils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating existing volume attachment record: b2910e4f-30fa-4d69-9aff-58c1a6d962a8 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-unplugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] No waiting events found dispatching network-vif-unplugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-unplugged-4e979ac6-7590-489a-9b38-bb5a88a85073 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Acquiring lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:44 user nova-compute[75051]: DEBUG nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] No waiting events found dispatching network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:42:44 user nova-compute[75051]: WARNING nova.compute.manager [req-29c1e589-127e-4c9b-9b9b-2eb2fa6f3457 req-af94cd74-1cb7-4815-ad59-41e4fa169303 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received unexpected event network-vif-plugged-4e979ac6-7590-489a-9b38-bb5a88a85073 for instance with vm_state active and task_state deleting.
Nov 24 19:42:45 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:42:45 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Took 0.66 seconds to deallocate network for instance.
Nov 24 19:42:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-eaade219-3545-4fcd-85cd-8425cba6887d req-e58d3a80-ee14-4b3b-8110-3102ec647908 service nova] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Received event network-vif-deleted-4e979ac6-7590-489a-9b38-bb5a88a85073 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:42:45 user nova-compute[75051]: INFO nova.compute.manager [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Took 0.75 seconds to detach 1 volumes for instance.
Nov 24 19:42:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 373112f3-6b78-44fe-9a02-5fd44e652cf2] Deleting volume: a7c86f16-78da-405d-9e3c-65b499e8c9a6 {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 19:42:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:46 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:42:46 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:42:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:46 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance 373112f3-6b78-44fe-9a02-5fd44e652cf2
Nov 24 19:42:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-0b5c7f59-1010-4aa5-99cb-dda97c7315b1 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "373112f3-6b78-44fe-9a02-5fd44e652cf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.141s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:49 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:42:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:42:50 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.149024963378906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 8f4c1c04-183b-4f92-b853-479c7afe5a06 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f1285495-56f1-4d11-bde0-0271a057a92c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:42:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVsmicjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:42:51 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:42:51 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:42:51 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c32b4-2e66-415e-bd58-95a9112a30ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:42:51 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6878c0-141f-402e-87d5-7046508c2a2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab] added
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a441300-c0f7-478f-a5f6-9200556ec500]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[558841fc-d7a9-4741-a042-3e7b83803926]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVsmicjN {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVsmicjN" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[35593a29-6102-4490-98b0-f173191db0ad]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVsmicjN'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf48a083-4078-4d09-880a-c01fbfc4613d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ec9084-b5e7-44ad-9c7d-7ad772cf6be0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742f146-c271-4837-95f1-f061ec98e9a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260]
Nov 24 19:42:51 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260] successful.
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b03276-21c5-4921-a190-03595c252390]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbac51-1fed-4ed5-ac86-5d71df2a8f06]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:51 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:42:51 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:42:51 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[200e4109-502b-40e3-8f72-4fa4f88be1f5]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVsmicjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26361353366643862', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361353366643862', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:42:52 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:42:52 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:42:52 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:42:52 user nova-compute[75051]:   <serial>de71d7fa-61d9-4ebc-8a5d-b8747efb82ab</serial>
Nov 24 19:42:52 user nova-compute[75051]: </disk>
Nov 24 19:42:52 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No VIF found with MAC fa:16:3e:73:a2:29, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:42:52 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:42:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d4117243-3096-4f6f-b165-14e2b354fd7e tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.433s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:42:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:42:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:42:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:42:55 user nova-compute[75051]: INFO nova.compute.manager [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attaching volume 766ae83c-4343-4b41-a287-7aafe9f5a9c6 to /dev/vdc
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.utils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4968bc4-493f-44d5-b446-36a990602905]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ee65e-d94a-4056-8a1f-ae729bc23df9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[17745d2d-7926-45bf-9ebb-dbd52d7c526b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b3261-4c8e-4ccb-a14d-67f312ec59bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:42:55 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:42:55 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[562236f3-148c-486a-b234-f8cdc16a65f5]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG os_brick.utils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:42:55 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating existing volume attachment record: e3b11784-9b50-4c52-b81f-bcc53f84dbb2 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:42:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:42:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:42:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UapChOgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:43:01 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:43:01 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:43:01 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eba1aa-254e-4354-84ec-95c84aedc08d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:43:01 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbcac53-fd80-47d1-9981-acd29635cd8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6] added
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4720dec-b8b1-4fc6-968a-ee8eae40bb60]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc4aaf-f2df-4597-9fae-fcfcdf039f2f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UapChOgF {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UapChOgF" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8996a15a-6119-44af-b0f6-9f2b7d0534cc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UapChOgF'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9186de94-7d41-4c1f-aa7f-2a59f800f63a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b767a7-f6c7-40fd-bc6a-b36ab4b9f0df]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfecbe7-801e-4d8f-b43e-9508290f9cda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260]
Nov 24 19:43:01 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260] successful.
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[099af218-0869-40f8-a2f4-889521e5dd3e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51ed6a-5f00-476c-993c-9601456cf2ae]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:01 user nova-compute[75051]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)
Nov 24 19:43:01 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f331d4-8ffc-4bb2-ba0d-79347bf2956b]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:01 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UapChOgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23131626364363361', 'path': '/dev/sdd'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131626364363361', 'path': '/dev/sdd'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:43:02 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:43:02 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:43:02 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:43:02 user nova-compute[75051]:   <serial>766ae83c-4343-4b41-a287-7aafe9f5a9c6</serial>
Nov 24 19:43:02 user nova-compute[75051]: </disk>
Nov 24 19:43:02 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:43:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:43:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:43:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:43:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] No VIF found with MAC fa:16:3e:73:a2:29, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:43:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a912dfb5-7018-409a-b4b1-bbf7b9af1926 tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.833s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:04 user nova-compute[75051]: INFO nova.compute.manager [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Detaching volume 766ae83c-4343-4b41-a287-7aafe9f5a9c6
Nov 24 19:43:04 user nova-compute[75051]: INFO nova.virt.block_device [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attempting to driver detach volume 766ae83c-4343-4b41-a287-7aafe9f5a9c6 from mountpoint /dev/vdc
Nov 24 19:43:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Attempting to detach device vdc from instance f1285495-56f1-4d11-bde0-0271a057a92c from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:43:04 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:43:04 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:43:04 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:43:04 user nova-compute[75051]:   <serial>766ae83c-4343-4b41-a287-7aafe9f5a9c6</serial>
Nov 24 19:43:04 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 19:43:04 user nova-compute[75051]: </disk>
Nov 24 19:43:04 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:43:04 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully detached device vdc from instance f1285495-56f1-4d11-bde0-0271a057a92c from the persistent domain config.
Nov 24 19:43:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f1285495-56f1-4d11-bde0-0271a057a92c from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:43:04 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:43:04 user nova-compute[75051]:   <source dev="/dev/sdd"/>
Nov 24 19:43:04 user nova-compute[75051]:   <target dev="vdc" bus="virtio"/>
Nov 24 19:43:04 user nova-compute[75051]:   <serial>766ae83c-4343-4b41-a287-7aafe9f5a9c6</serial>
Nov 24 19:43:04 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 24 19:43:04 user nova-compute[75051]: </disk>
Nov 24 19:43:04 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:43:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:24 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f1285495-56f1-4d11-bde0-0271a057a92c is timed out.
Nov 24 19:43:24 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully detached device vdc from instance f1285495-56f1-4d11-bde0-0271a057a92c from the live domain config.
Nov 24 19:43:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UapChOgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:43:24 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b176c4-57d8-4dcc-880f-08dc68c55180]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:43:24 user nova-compute[75051]: No targets found.
Nov 24 19:43:24 user nova-compute[75051]: iSNS:
Nov 24 19:43:24 user nova-compute[75051]: No targets found.
Nov 24 19:43:24 user nova-compute[75051]: STATIC:
Nov 24 19:43:24 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab
Nov 24 19:43:24 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:43:24 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:43:24 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6
Nov 24 19:43:24 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:43:24 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:43:24 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634
Nov 24 19:43:24 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:43:24 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:43:24 user nova-compute[75051]: FIRMWARE:
Nov 24 19:43:24 user nova-compute[75051]: No targets found.
Nov 24 19:43:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:43:24 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:43:24 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[092196be-d1da-4369-8fd5-b2235d5b3f9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a753aebb-6588-4d19-9a6e-78e9f18faac1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:24 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:24 user nova-compute[75051]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)
Nov 24 19:43:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:24 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:24 user nova-compute[75051]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 (non-flash)
Nov 24 19:43:24 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c0383eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6'): ({'sdd'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Removing single pathed devices sdd {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dcff69-7bcb-42d6-ae68-4d99121466b9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[905d4bf7-3432-44f4-9235-2d4fa9dabaa9]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Flushing IO for device /dev/sdd {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4407661c-4442-40d5-a7d2-54921d88bb0b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:43:24 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2165406a-f319-459f-a89b-7682d4583b52]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] SCSI volumes sdd have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb34301-2bad-43a9-bbd7-6617d69e1be1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba2f36-4fb4-4939-a9d1-1e10e86aadd2]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260]
Nov 24 19:43:25 user nova-compute[75051]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6, portal: 172.16.0.220,3260] successful.
Nov 24 19:43:25 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:766ae83c-4343-4b41-a287-7aafe9f5a9c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a88ec43-b058-4830-96a4-5f783b7fc54b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== disconnect_volume: return (298ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG nova.objects.instance [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:43:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-f7d1f5a6-395f-401d-97d8-5b1b006c35fc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.623s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:36 user nova-compute[75051]: INFO nova.compute.manager [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Terminating instance
Nov 24 19:43:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-7341f5b3-4794-4450-b612-500c2e444a50 req-e58b612f-5c95-4787-8cfc-322438ae8b33 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Instance destroyed successfully.
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid 8f4c1c04-183b-4f92-b853-479c7afe5a06 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-892612433',display_name='tempest-TestVolumeBootPattern-volume-backed-server-892612433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-892612433',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzdsBNkzSNPGbW4lbC8Bk/dMpTiy1zjiXqU4VvHdQ5Y+evT18ZsD4gg1QoL+jw3R7Jn/uS0BVSxEUSKXTlaJSsgshIPD+6p7x7bmjTkSbpqk7giGe7mi2uU7R3QKZtcyA==',key_name='tempest-keypair-550381502',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:39:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-znohvxka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=8f4c1c04-183b-4f92-b853-479c7afe5a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "391ba16a-6ca7-4155-991e-41bbf27065f7", "address": "fa:16:3e:b6:1e:dd", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap391ba16a-6c", "ovs_interfaceid": "391ba16a-6ca7-4155-991e-41bbf27065f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_vif [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap391ba16a-6c, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fba6534-71e5-401f-b581-522f4e97f296) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:37 user nova-compute[75051]: INFO os_vif [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:1e:dd,bridge_name='br-int',has_traffic_filtering=True,id=391ba16a-6ca7-4155-991e-41bbf27065f7,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap391ba16a-6c')
Nov 24 19:43:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GaHWzBnF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:43:37 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf53748c-ef75-4f10-8b99-9edc394a345b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:43:37 user nova-compute[75051]: No targets found.
Nov 24 19:43:37 user nova-compute[75051]: iSNS:
Nov 24 19:43:37 user nova-compute[75051]: No targets found.
Nov 24 19:43:37 user nova-compute[75051]: STATIC:
Nov 24 19:43:37 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab
Nov 24 19:43:37 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:43:37 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:43:37 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634
Nov 24 19:43:37 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:43:37 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:43:37 user nova-compute[75051]: FIRMWARE:
Nov 24 19:43:37 user nova-compute[75051]: No targets found.
Nov 24 19:43:37 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:43:37 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:43:37 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bb8e5-3d31-4d79-9aeb-8ca15e87cc9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ce9815-75c1-49ef-9b1f-745633748d5a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:37 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:37 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 (non-flash)
Nov 24 19:43:37 user nova-compute[75051]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:43:37 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a05ab910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b15bdd-f450-4517-ae1d-3d5d196c11bf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf931b9-e390-426b-9bc3-bdc04eefc9d5]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d5d047-6f8e-4331-9a72-ae536511683d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea52632-9110-48e6-ac88-e0d0a33a6275]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a40e9dc',) {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949ea75-9394-4669-bec1-c7bacc15ebfd]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:43:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c004b1a-37d2-4ea1-9e4f-4115ca6f6831]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[582dad76-3f3d-4eda-a3fe-abc3b9eb8c20]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260]
Nov 24 19:43:38 user nova-compute[75051]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634, portal: 172.16.0.220,3260] successful.
Nov 24 19:43:38 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1302506-69f8-4552-bc38-cf4d27cb4b8b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (325ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:43:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Deleting instance files /opt/stack/data/nova/instances/8f4c1c04-183b-4f92-b853-479c7afe5a06_del
Nov 24 19:43:38 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Deletion of /opt/stack/data/nova/instances/8f4c1c04-183b-4f92-b853-479c7afe5a06_del complete
Nov 24 19:43:38 user nova-compute[75051]: INFO nova.compute.manager [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 24 19:43:38 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:43:39 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Took 0.84 seconds to deallocate network for instance.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:39 user nova-compute[75051]: WARNING nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state active and task_state deleting.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:39 user nova-compute[75051]: WARNING nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state active and task_state deleting.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:39 user nova-compute[75051]: WARNING nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state active and task_state deleting.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-unplugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Acquiring lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] No waiting events found dispatching network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:43:39 user nova-compute[75051]: WARNING nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received unexpected event network-vif-plugged-391ba16a-6ca7-4155-991e-41bbf27065f7 for instance with vm_state active and task_state deleting.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee02c460-65e0-4ba0-bf5c-f70cc48fb544 req-7ba98a92-7135-4d36-a8f1-681825294b44 service nova] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Received event network-vif-deleted-391ba16a-6ca7-4155-991e-41bbf27065f7 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:43:39 user nova-compute[75051]: INFO nova.compute.manager [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Took 0.70 seconds to detach 1 volumes for instance.
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.manager [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 8f4c1c04-183b-4f92-b853-479c7afe5a06] Deleting volume: b9accf96-2afe-4c1e-a8a6-eeb53a1ea634 {{(pid=75051) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:43:39 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:43:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:40 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance 8f4c1c04-183b-4f92-b853-479c7afe5a06
Nov 24 19:43:40 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-1ae186cd-f6f2-4061-8b0f-dd83ea64ad7a tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "8f4c1c04-183b-4f92-b853-479c7afe5a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:43 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:43:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:43:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:43:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:43:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.147315979003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance f1285495-56f1-4d11-bde0-0271a057a92c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:43:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:43:52 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:43:52 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:43:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:43:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:43:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:43:53 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [{"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-f1285495-56f1-4d11-bde0-0271a057a92c" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:43:54 user nova-compute[75051]: INFO nova.compute.manager [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Detaching volume de71d7fa-61d9-4ebc-8a5d-b8747efb82ab
Nov 24 19:43:54 user nova-compute[75051]: INFO nova.virt.block_device [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Attempting to driver detach volume de71d7fa-61d9-4ebc-8a5d-b8747efb82ab from mountpoint /dev/vdb
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Attempting to detach device vdb from instance f1285495-56f1-4d11-bde0-0271a057a92c from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:43:54 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:43:54 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:43:54 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:43:54 user nova-compute[75051]:   <serial>de71d7fa-61d9-4ebc-8a5d-b8747efb82ab</serial>
Nov 24 19:43:54 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:43:54 user nova-compute[75051]: </disk>
Nov 24 19:43:54 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:43:54 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully detached device vdb from instance f1285495-56f1-4d11-bde0-0271a057a92c from the persistent domain config.
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f1285495-56f1-4d11-bde0-0271a057a92c from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:43:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:43:54 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:43:54 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:43:54 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:43:54 user nova-compute[75051]:   <serial>de71d7fa-61d9-4ebc-8a5d-b8747efb82ab</serial>
Nov 24 19:43:54 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:43:54 user nova-compute[75051]: </disk>
Nov 24 19:43:54 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:43:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:43:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:43:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:15 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f1285495-56f1-4d11-bde0-0271a057a92c is timed out.
Nov 24 19:44:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully detached device vdb from instance f1285495-56f1-4d11-bde0-0271a057a92c from the live domain config.
Nov 24 19:44:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVsmicjN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:44:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b6b180-64c6-40ec-894c-90df227169e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:44:15 user nova-compute[75051]: No targets found.
Nov 24 19:44:15 user nova-compute[75051]: iSNS:
Nov 24 19:44:15 user nova-compute[75051]: No targets found.
Nov 24 19:44:15 user nova-compute[75051]: STATIC:
Nov 24 19:44:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab
Nov 24 19:44:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:44:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:44:15 user nova-compute[75051]: FIRMWARE:
Nov 24 19:44:15 user nova-compute[75051]: No targets found.
Nov 24 19:44:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:44:15 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:44:15 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9754941c-4c2b-426b-bf3b-e3b31e604bc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e40c4d9-f921-41f2-9613-f5c22df72726]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:44:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab (non-flash)
Nov 24 19:44:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a0442ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055e11a-002d-4779-a9d4-2342da7022ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a20add-c5cb-4902-8bbf-1e0210a0cf5a]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a2a4ad-ff78-4a8b-9769-0e97439597f4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0bc707-2c65-4e90-99ac-a23be6d93ddf]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1e998-ebd6-4ca5-9199-d8014158835e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9569ee0c-5d52-4e60-b4cb-845af01043f8]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260]
Nov 24 19:44:15 user nova-compute[75051]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab, portal: 172.16.0.220,3260] successful.
Nov 24 19:44:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de71d7fa-61d9-4ebc-8a5d-b8747efb82ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d70b4-d4a4-410b-af8a-af068a7355e6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] <== disconnect_volume: return (282ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:44:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:44:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'flavor' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:44:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-47ac48c2-2c8f-4432-9c8a-4d677b2d15ba tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.570s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:44:18 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:44:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:44:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:36 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:44:36 user nova-compute[75051]: INFO nova.compute.claims [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Claim successful on node user
Nov 24 19:44:36 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:44:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.policy [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:44:37 user nova-compute[75051]: INFO nova.virt.block_device [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Booting with volume 53fbed13-2e63-4a77-9692-616a49a102c5 at /dev/vda
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.utils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[24391fc1-5e02-4ed1-b087-fab46163906e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5158237-1944-4cd4-acd4-cdff826f06db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[989cf0da-18a5-4305-aafa-36aed74fab51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b93b87-394c-4e29-ae4a-edef4d9f935e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:44:37 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:44:37 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a5f43-d55f-4fbf-8265-cc05a0198f1e]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG os_brick.utils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating existing volume attachment record: 2d273060-f55e-43cc-b5cc-04faea922c56 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Successfully created port: eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:44:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Successfully updated port: eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-changed-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.compute.manager [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Refreshing instance network info cache due to event network-changed-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] Acquiring lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Instance network_info: |[{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] Acquired lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:44:38 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Refreshing network info cache for port eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:44:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updated VIF entry in instance network info cache for port eeb353ce-7e26-4b71-90cc-dc4d7e3e395f. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:44:39 user nova-compute[75051]: DEBUG nova.network.neutron [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:44:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f1b671bd-f2af-4e8e-b574-8722ac90b7a0 req-d1ec8520-a769-4082-a2e4-bedd914bd42f service nova] Releasing lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:44:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:44:43 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Creating image(s)
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Ensure instance console log exists: /opt/stack/data/nova/instances/06d8821c-7f1b-4237-b54b-c5137adc2c3e/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Start _get_guest_xml network_info=[{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06d8821c-7f1b-4237-b54b-c5137adc2c3e', 'attached_at': '', 'detached_at': '', 'volume_id': '53fbed13-2e63-4a77-9692-616a49a102c5', 'serial': '53fbed13-2e63-4a77-9692-616a49a102c5'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2d273060-f55e-43cc-b5cc-04faea922c56', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:44:43 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:44:43 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:44:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:44:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:44:43 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208542d-13d4-465b-9cb5-e779df10741e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:44:43 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a6b12-17fe-401f-978a-567666e5c12e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5] added
Nov 24 19:44:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d3a518-03e7-4dfd-bbe8-626c38a8647f]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb727f56-eb29-4741-b55b-1826bf4d891d]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlVyTSkI {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlVyTSkI" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06ef44-5ac6-4181-a33c-6e1567d799c9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlVyTSkI'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d0e79a-3924-40f2-9db3-bb6ef5531910]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f2bb8-3efc-44f5-a3c1-233b527345d0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:44:43 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:44:43 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:44:43 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:44:43 user nova-compute[75051]: 
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4355667d-789a-4448-99e5-95720e996c2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]
Nov 24 19:44:43 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.
Nov 24 19:44:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe5c8c2-88b3-43df-b897-72528a62e415]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aafe30b-d8d9-4d34-8f5c-ba7800e62425]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:44:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:44:43 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[883370ea-5b2c-45e7-9562-bf1bc84fc665]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:44:43 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.257s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '23630323866633434', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323866633434', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352421374',display_name='tempest-TestVolumeBootPattern-server-1352421374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352421374',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-2par6y0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:44:37Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=06d8821c-7f1b-4237-b54b-c5137adc2c3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid 06d8821c-7f1b-4237-b54b-c5137adc2c3e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:44:44 user nova-compute[75051]:   <uuid>06d8821c-7f1b-4237-b54b-c5137adc2c3e</uuid>
Nov 24 19:44:44 user nova-compute[75051]:   <name>instance-00000032</name>
Nov 24 19:44:44 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:44:44 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:44:44 user nova-compute[75051]:   <metadata>
Nov 24 19:44:44 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:44:44 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:44:44 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-server-1352421374</nova:name>
Nov 24 19:44:44 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:44:43</nova:creationTime>
Nov 24 19:44:44 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:44:44 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:44:44 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:44:44 user nova-compute[75051]:       <nova:owner>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:44:44 user nova-compute[75051]:       </nova:owner>
Nov 24 19:44:44 user nova-compute[75051]:       <nova:ports>
Nov 24 19:44:44 user nova-compute[75051]:         <nova:port uuid="eeb353ce-7e26-4b71-90cc-dc4d7e3e395f">
Nov 24 19:44:44 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 24 19:44:44 user nova-compute[75051]:         </nova:port>
Nov 24 19:44:44 user nova-compute[75051]:       </nova:ports>
Nov 24 19:44:44 user nova-compute[75051]:     </nova:instance>
Nov 24 19:44:44 user nova-compute[75051]:   </metadata>
Nov 24 19:44:44 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:44:44 user nova-compute[75051]:     <system>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="serial">06d8821c-7f1b-4237-b54b-c5137adc2c3e</entry>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="uuid">06d8821c-7f1b-4237-b54b-c5137adc2c3e</entry>
Nov 24 19:44:44 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:44:44 user nova-compute[75051]:     </system>
Nov 24 19:44:44 user nova-compute[75051]:   </sysinfo>
Nov 24 19:44:44 user nova-compute[75051]:   <os>
Nov 24 19:44:44 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:44:44 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:44:44 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:44:44 user nova-compute[75051]:   </os>
Nov 24 19:44:44 user nova-compute[75051]:   <features>
Nov 24 19:44:44 user nova-compute[75051]:     <acpi/>
Nov 24 19:44:44 user nova-compute[75051]:     <apic/>
Nov 24 19:44:44 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:44:44 user nova-compute[75051]:   </features>
Nov 24 19:44:44 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:44:44 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:44:44 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:44:44 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:44:44 user nova-compute[75051]:   </clock>
Nov 24 19:44:44 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:44:44 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:44:44 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:44:44 user nova-compute[75051]:   </cpu>
Nov 24 19:44:44 user nova-compute[75051]:   <devices>
Nov 24 19:44:44 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:44:44 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:44:44 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 19:44:44 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:44:44 user nova-compute[75051]:       <serial>53fbed13-2e63-4a77-9692-616a49a102c5</serial>
Nov 24 19:44:44 user nova-compute[75051]:     </disk>
Nov 24 19:44:44 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:44:44 user nova-compute[75051]:       <mac address="fa:16:3e:d4:1a:b7"/>
Nov 24 19:44:44 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:44:44 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:44:44 user nova-compute[75051]:       <target dev="tapeeb353ce-7e"/>
Nov 24 19:44:44 user nova-compute[75051]:     </interface>
Nov 24 19:44:44 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:44:44 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/06d8821c-7f1b-4237-b54b-c5137adc2c3e/console.log" append="off"/>
Nov 24 19:44:44 user nova-compute[75051]:     </serial>
Nov 24 19:44:44 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:44:44 user nova-compute[75051]:     <video>
Nov 24 19:44:44 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:44:44 user nova-compute[75051]:     </video>
Nov 24 19:44:44 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:44:44 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:44:44 user nova-compute[75051]:     </rng>
Nov 24 19:44:44 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:44:44 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:44:44 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:44:44 user nova-compute[75051]:     </memballoon>
Nov 24 19:44:44 user nova-compute[75051]:   </devices>
Nov 24 19:44:44 user nova-compute[75051]: </domain>
Nov 24 19:44:44 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352421374',display_name='tempest-TestVolumeBootPattern-server-1352421374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352421374',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-2par6y0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:44:37Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=06d8821c-7f1b-4237-b54b-c5137adc2c3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG os_vif [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd46acc63-8045-5375-8a85-02443b8f962c', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb353ce-7e, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeeb353ce-7e, col_values=(('qos', UUID('d678aece-96a5-457a-b580-995dc1aea2fd')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeeb353ce-7e, col_values=(('external_ids', {'iface-id': 'eeb353ce-7e26-4b71-90cc-dc4d7e3e395f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:1a:b7', 'vm-uuid': '06d8821c-7f1b-4237-b54b-c5137adc2c3e'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:44 user nova-compute[75051]: INFO os_vif [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e')
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:44:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:d4:1a:b7, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:45 user nova-compute[75051]: INFO nova.compute.manager [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Terminating instance
Nov 24 19:44:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG nova.compute.manager [req-df2054a3-a1f3-4852-829e-ee94c1a56463 req-54d6f120-e88b-491c-bf8a-0b048bcd727c service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:44:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.compute.manager [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] No waiting events found dispatching network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:46 user nova-compute[75051]: WARNING nova.compute.manager [req-fea2d9dd-efab-4b8d-b4e8-0585e22cd52c req-99df6e32-e244-4fb0-bc23-a89a57d9873d service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received unexpected event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f for instance with vm_state building and task_state spawning.
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Instance destroyed successfully.
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.objects.instance [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lazy-loading 'resources' on Instance uuid f1285495-56f1-4d11-bde0-0271a057a92c {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:40:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1262145732',display_name='tempest-TestServerVolumeAttachmentScenario-server-1262145732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1262145732',id=49,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaS7a6SgYc29rdWHg0273XQNEcW/3X7Y2p3f8FnFfBFfd/BNZJg3dJG1m7j1XpEfqemdX69w8+CIMZkA7kq9JgzHQkXX4jfRMl/5KjEUNhtXsryHwC/C+1A8Chmtu+Ozg==',key_name='tempest-keypair-177155023',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:40:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3850bca8c6341ad82ff8b0e86297ec8',ramdisk_id='',reservation_id='r-rerm4yes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-586057998',owner_user_name='tempest-TestServerVolumeAttachmentScenario-586057998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:40:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9d99c1975094995b38566872a5f6540',uuid=f1285495-56f1-4d11-bde0-0271a057a92c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converting VIF {"id": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "address": "fa:16:3e:73:a2:29", "network": {"id": "ee02a711-9b95-434b-8a10-9ea76b08faf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2107254141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3850bca8c6341ad82ff8b0e86297ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8e8f64c-e7", "ovs_interfaceid": "b8e8f64c-e74d-4f63-9dfd-85596766f698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG os_vif [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8e8f64c-e7, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88fda98e-1b87-419c-a381-cac04c891f21) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:44:46 user nova-compute[75051]: INFO os_vif [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:a2:29,bridge_name='br-int',has_traffic_filtering=True,id=b8e8f64c-e74d-4f63-9dfd-85596766f698,network=Network(ee02a711-9b95-434b-8a10-9ea76b08faf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8e8f64c-e7')
Nov 24 19:44:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Deleting instance files /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c_del
Nov 24 19:44:46 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Deletion of /opt/stack/data/nova/instances/f1285495-56f1-4d11-bde0-0271a057a92c_del complete
Nov 24 19:44:46 user nova-compute[75051]: INFO nova.compute.manager [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Took 1.48 seconds to destroy the instance on the hypervisor.
Nov 24 19:44:46 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:44:46 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:44:47 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Took 0.88 seconds to deallocate network for instance.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-7df66e45-553b-407d-8fb3-fd0dc50b1db5 req-e627d1f1-ecb1-40fb-902c-6bd10e3e1e5c service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-deleted-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:47 user nova-compute[75051]: WARNING nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state deleted and task_state None.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:47 user nova-compute[75051]: WARNING nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state deleted and task_state None.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:47 user nova-compute[75051]: WARNING nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state deleted and task_state None.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:47 user nova-compute[75051]: WARNING nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-unplugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state deleted and task_state None.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Acquiring lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] Lock "f1285495-56f1-4d11-bde0-0271a057a92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] No waiting events found dispatching network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:47 user nova-compute[75051]: WARNING nova.compute.manager [req-c4ddb293-9665-42f3-b7d3-159bf2b6fffe req-c70ee266-6bc3-4321-ac65-7395f6973b75 service nova] [instance: f1285495-56f1-4d11-bde0-0271a057a92c] Received unexpected event network-vif-plugged-b8e8f64c-e74d-4f63-9dfd-85596766f698 for instance with vm_state deleted and task_state None.
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:44:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:47 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Deleted allocations for instance f1285495-56f1-4d11-bde0-0271a057a92c
Nov 24 19:44:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-60c208f4-98ee-4855-92af-37d5b0d4c8dc tempest-TestServerVolumeAttachmentScenario-586057998 tempest-TestServerVolumeAttachmentScenario-586057998-project-member] Lock "f1285495-56f1-4d11-bde0-0271a057a92c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.785s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.compute.manager [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] No waiting events found dispatching network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:44:48 user nova-compute[75051]: WARNING nova.compute.manager [req-f52925cb-23e1-4b8f-b999-a6dee95ca713 req-95071a64-7223-4ca8-a2bd-11633bad7864 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received unexpected event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f for instance with vm_state building and task_state spawning.
Nov 24 19:44:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:44:48 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Instance spawned successfully.
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:44:48 user nova-compute[75051]: INFO nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 24 19:44:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:44:48 user nova-compute[75051]: INFO nova.compute.manager [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Took 11.83 seconds to build instance.
Nov 24 19:44:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ffdf6538-4362-4f69-8977-cc55543375cf tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.933s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:44:50 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:44:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:44:51 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.17282485961914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 06d8821c-7f1b-4237-b54b-c5137adc2c3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:44:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:44:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 06d8821c-7f1b-4237-b54b-c5137adc2c3e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:44:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:44:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:45:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:36 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:41 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:45:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:46 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:46 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:46 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:45:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:45:51 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:45:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:45:52 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=25.171531677246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 06d8821c-7f1b-4237-b54b-c5137adc2c3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:45:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:45:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:45:56 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 06d8821c-7f1b-4237-b54b-c5137adc2c3e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:45:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:45:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:45:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:45:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:45:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:06 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:11 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:16 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:21 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:26 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-changed-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Refreshing instance network info cache due to event network-changed-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] Acquiring lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] Acquired lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Refreshing network info cache for port eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updated VIF entry in instance network info cache for port eeb353ce-7e26-4b71-90cc-dc4d7e3e395f. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.network.neutron [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [{"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1e5b8513-ab87-433a-a2a3-8c25ce31909f req-da4af9c5-c4a1-48d8-bb3b-766842e57d39 service nova] Releasing lock "refresh_cache-06d8821c-7f1b-4237-b54b-c5137adc2c3e" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:29 user nova-compute[75051]: INFO nova.compute.manager [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Terminating instance
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-unplugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] No waiting events found dispatching network-vif-unplugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:46:29 user nova-compute[75051]: DEBUG nova.compute.manager [req-21e44a03-85df-42d0-8002-70f1b7ca88c2 req-332679b0-b07a-4b9a-ad03-fbe21a822a53 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-unplugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:46:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Instance destroyed successfully.
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.objects.instance [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid 06d8821c-7f1b-4237-b54b-c5137adc2c3e {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1352421374',display_name='tempest-TestVolumeBootPattern-server-1352421374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1352421374',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-2par6y0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:44:49Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=06d8821c-7f1b-4237-b54b-c5137adc2c3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "address": "fa:16:3e:d4:1a:b7", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb353ce-7e", "ovs_interfaceid": "eeb353ce-7e26-4b71-90cc-dc4d7e3e395f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_vif [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb353ce-7e, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d678aece-96a5-457a-b580-995dc1aea2fd) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:30 user nova-compute[75051]: INFO os_vif [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:1a:b7,bridge_name='br-int',has_traffic_filtering=True,id=eeb353ce-7e26-4b71-90cc-dc4d7e3e395f,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb353ce-7e')
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:46:30 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a369f55-edd7-45ea-b5b8-c3cd9eea9f11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:46:30 user nova-compute[75051]: No targets found.
Nov 24 19:46:30 user nova-compute[75051]: iSNS:
Nov 24 19:46:30 user nova-compute[75051]: No targets found.
Nov 24 19:46:30 user nova-compute[75051]: STATIC:
Nov 24 19:46:30 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5
Nov 24 19:46:30 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:46:30 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:46:30 user nova-compute[75051]: FIRMWARE:
Nov 24 19:46:30 user nova-compute[75051]: No targets found.
Nov 24 19:46:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:46:30 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:46:30 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[927dcb62-e218-4c5e-9f47-aa332d522025]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[facfa313-b776-4724-b036-345ae1cbbfc7]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:46:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:46:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a055a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8455b17-0181-4d9a-ae3c-623b3a78e0db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436c0c2-ec24-487e-a0fa-f3835c03ac00]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fecbbb-e928-4dcd-b25c-c69791f56236]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5342e46-69e8-40ac-bafc-8ab10ccc4d23]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8901a500-6028fc44a51f612f', '/dev/disk/by-id/scsi-23630323866633434', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8901a500') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edafb5-f20e-4611-b09d-472e944747aa]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ec5a7-a927-4e21-82e3-b19fce3f742a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd258e-6eed-4dd0-902e-541353ff826a]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]
Nov 24 19:46:30 user nova-compute[75051]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.
Nov 24 19:46:30 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d8668-f1f4-4da3-bcf7-5640770368ae]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (302ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:46:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Deleting instance files /opt/stack/data/nova/instances/06d8821c-7f1b-4237-b54b-c5137adc2c3e_del
Nov 24 19:46:30 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Deletion of /opt/stack/data/nova/instances/06d8821c-7f1b-4237-b54b-c5137adc2c3e_del complete
Nov 24 19:46:30 user nova-compute[75051]: INFO nova.compute.manager [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 24 19:46:30 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:46:30 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:46:31 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:46:31 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Took 0.72 seconds to deallocate network for instance.
Nov 24 19:46:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-102de851-e2ea-4e91-aba3-30483177c7dd req-36a08659-f139-4197-ba17-d0558c1f3fce service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-deleted-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] Acquiring lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG nova.compute.manager [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] No waiting events found dispatching network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:46:32 user nova-compute[75051]: WARNING nova.compute.manager [req-d8a4b4e6-b9a5-4bd7-8e60-eedc24cf3b79 req-00b973fe-0337-4a3e-aaeb-ff40e9c73164 service nova] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Received unexpected event network-vif-plugged-eeb353ce-7e26-4b71-90cc-dc4d7e3e395f for instance with vm_state active and task_state deleting.
Nov 24 19:46:32 user nova-compute[75051]: INFO nova.compute.manager [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 06d8821c-7f1b-4237-b54b-c5137adc2c3e] Took 0.73 seconds to detach 1 volumes for instance.
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:32 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance 06d8821c-7f1b-4237-b54b-c5137adc2c3e
Nov 24 19:46:32 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-a8424225-6278-4084-a2ee-388021f6b9f7 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "06d8821c-7f1b-4237-b54b-c5137adc2c3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.082s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:47 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:47 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:46:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:52 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:46:53 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:46:53 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=25.170665740966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:46:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:46:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:46:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:46:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:46:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:46:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:46:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:46:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:47:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:47:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:47:22 user nova-compute[75051]: INFO nova.compute.claims [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Claim successful on node user
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:47:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.policy [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:47:22 user nova-compute[75051]: INFO nova.virt.block_device [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Booting with volume 53fbed13-2e63-4a77-9692-616a49a102c5 at /dev/vda
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.utils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088bb0c-d9ba-446a-9030-2ba1603dc6a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c123191-5137-489a-82bc-b742d4cba812]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929c422-9312-43ca-a547-ee2561ba361a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b19119-150d-4908-9b1d-cdabd703aa84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:47:22 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:47:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d1a80-0dd6-4e37-b0c0-ed4a86fa6178]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG os_brick.utils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating existing volume attachment record: 82ff1369-7bc3-44ed-b884-e0e8853fb40f {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:47:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Successfully created port: 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Successfully updated port: 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing instance network info cache due to event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Instance network_info: |[{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:47:23 user nova-compute[75051]: DEBUG nova.network.neutron [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:47:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated VIF entry in instance network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:47:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:47:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-741eb29e-4e1e-49d8-8ddb-74233581557f req-f12d8e5f-ce47-4b6a-994f-dfed54de0f0e service nova] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:47:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:47:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Creating image(s)
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Ensure instance console log exists: /opt/stack/data/nova/instances/44d1a6a7-26da-4d52-be5b-f6e801b67313/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Start _get_guest_xml network_info=[{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '44d1a6a7-26da-4d52-be5b-f6e801b67313', 'attached_at': '', 'detached_at': '', 'volume_id': '53fbed13-2e63-4a77-9692-616a49a102c5', 'serial': '53fbed13-2e63-4a77-9692-616a49a102c5'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '82ff1369-7bc3-44ed-b884-e0e8853fb40f', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:47:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:47:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:47:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:47:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:47:28 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734c51c-0b9f-410c-b88f-578f97369a56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:47:28 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49def80-f6da-47c4-992b-7335c1238b12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5] added
Nov 24 19:47:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[89622568-c66a-4a00-bc4f-9107f51b6750]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c61807-ed19-411e-8b65-07f164233cc2]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlVyTSkI {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZlVyTSkI" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4117d-1296-40bf-845e-224603e347d4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZlVyTSkI'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e7346-0485-4b0a-bf34-0cf44901f5c4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69b69ca-328d-4134-a71f-93d27ace5c1e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:47:28 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:47:28 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:47:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:47:28 user nova-compute[75051]: 
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad709b8-49fa-45de-999a-806afa90b68b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]
Nov 24 19:47:28 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.
Nov 24 19:47:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af0d1a-4c20-447d-af52-e3c7afb99bfa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d0d079-b28b-45b7-acb1-5aa37c40e81a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:47:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:47:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3eba9f-9db6-4bcf-a99f-18454b550fd5]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:47:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '23630323866633434', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323866633434', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744772481',display_name='tempest-TestVolumeBootPattern-server-744772481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744772481',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-c0vhjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:47:22Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=44d1a6a7-26da-4d52-be5b-f6e801b67313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:47:29 user nova-compute[75051]:   <uuid>44d1a6a7-26da-4d52-be5b-f6e801b67313</uuid>
Nov 24 19:47:29 user nova-compute[75051]:   <name>instance-00000033</name>
Nov 24 19:47:29 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:47:29 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:47:29 user nova-compute[75051]:   <metadata>
Nov 24 19:47:29 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:47:29 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:47:29 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-server-744772481</nova:name>
Nov 24 19:47:29 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:47:28</nova:creationTime>
Nov 24 19:47:29 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:47:29 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:47:29 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:47:29 user nova-compute[75051]:       <nova:owner>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:47:29 user nova-compute[75051]:       </nova:owner>
Nov 24 19:47:29 user nova-compute[75051]:       <nova:ports>
Nov 24 19:47:29 user nova-compute[75051]:         <nova:port uuid="0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c">
Nov 24 19:47:29 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 24 19:47:29 user nova-compute[75051]:         </nova:port>
Nov 24 19:47:29 user nova-compute[75051]:       </nova:ports>
Nov 24 19:47:29 user nova-compute[75051]:     </nova:instance>
Nov 24 19:47:29 user nova-compute[75051]:   </metadata>
Nov 24 19:47:29 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:47:29 user nova-compute[75051]:     <system>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="serial">44d1a6a7-26da-4d52-be5b-f6e801b67313</entry>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="uuid">44d1a6a7-26da-4d52-be5b-f6e801b67313</entry>
Nov 24 19:47:29 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:47:29 user nova-compute[75051]:     </system>
Nov 24 19:47:29 user nova-compute[75051]:   </sysinfo>
Nov 24 19:47:29 user nova-compute[75051]:   <os>
Nov 24 19:47:29 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:47:29 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:47:29 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:47:29 user nova-compute[75051]:   </os>
Nov 24 19:47:29 user nova-compute[75051]:   <features>
Nov 24 19:47:29 user nova-compute[75051]:     <acpi/>
Nov 24 19:47:29 user nova-compute[75051]:     <apic/>
Nov 24 19:47:29 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:47:29 user nova-compute[75051]:   </features>
Nov 24 19:47:29 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:47:29 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:47:29 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:47:29 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:47:29 user nova-compute[75051]:   </clock>
Nov 24 19:47:29 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:47:29 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:47:29 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:47:29 user nova-compute[75051]:   </cpu>
Nov 24 19:47:29 user nova-compute[75051]:   <devices>
Nov 24 19:47:29 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:47:29 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:47:29 user nova-compute[75051]:       <source dev="/dev/sdb"/>
Nov 24 19:47:29 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:47:29 user nova-compute[75051]:       <serial>53fbed13-2e63-4a77-9692-616a49a102c5</serial>
Nov 24 19:47:29 user nova-compute[75051]:     </disk>
Nov 24 19:47:29 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:47:29 user nova-compute[75051]:       <mac address="fa:16:3e:0d:12:57"/>
Nov 24 19:47:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:47:29 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:47:29 user nova-compute[75051]:       <target dev="tap0fcb1dc3-81"/>
Nov 24 19:47:29 user nova-compute[75051]:     </interface>
Nov 24 19:47:29 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:47:29 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/44d1a6a7-26da-4d52-be5b-f6e801b67313/console.log" append="off"/>
Nov 24 19:47:29 user nova-compute[75051]:     </serial>
Nov 24 19:47:29 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:47:29 user nova-compute[75051]:     <video>
Nov 24 19:47:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:47:29 user nova-compute[75051]:     </video>
Nov 24 19:47:29 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:47:29 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:47:29 user nova-compute[75051]:     </rng>
Nov 24 19:47:29 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:47:29 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:47:29 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:47:29 user nova-compute[75051]:     </memballoon>
Nov 24 19:47:29 user nova-compute[75051]:   </devices>
Nov 24 19:47:29 user nova-compute[75051]: </domain>
Nov 24 19:47:29 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744772481',display_name='tempest-TestVolumeBootPattern-server-744772481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744772481',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-c0vhjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:47:22Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=44d1a6a7-26da-4d52-be5b-f6e801b67313,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG os_vif [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efdae835-c88c-5974-9af8-2cc4739f12ef', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fcb1dc3-81, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fcb1dc3-81, col_values=(('qos', UUID('c6681103-67cb-4323-bcde-e19caf40a986')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fcb1dc3-81, col_values=(('external_ids', {'iface-id': '0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:12:57', 'vm-uuid': '44d1a6a7-26da-4d52-be5b-f6e801b67313'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:29 user nova-compute[75051]: INFO os_vif [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81')
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:47:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:0d:12:57, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] No waiting events found dispatching network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:47:31 user nova-compute[75051]: WARNING nova.compute.manager [req-eed18101-bfcc-42cf-8aec-6fd567b5c9fe req-6cbd36a8-9a6f-49fb-8873-a1d38fbe4475 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received unexpected event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c for instance with vm_state building and task_state spawning.
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:47:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Instance spawned successfully.
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:47:33 user nova-compute[75051]: INFO nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] No waiting events found dispatching network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:47:33 user nova-compute[75051]: WARNING nova.compute.manager [req-d53df835-3899-4a18-9e3a-9b7b03b12fea req-8c1645b0-f985-4ee6-b386-019f2d6e671e service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received unexpected event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c for instance with vm_state building and task_state spawning.
Nov 24 19:47:33 user nova-compute[75051]: INFO nova.compute.manager [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Took 11.58 seconds to build instance.
Nov 24 19:47:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b467d3ae-b997-4a86-88e8-bbeb2e578e67 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.682s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:47:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:53 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:47:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:47:54 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=25.169021606445312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:47:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:47:57 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:47:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:47:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:47:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:47:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:47:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:48:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:48 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:48 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:48:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:48:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:48:54 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:48:55 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:48:55 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.168411254882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:48:55 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:48:58 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:48:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:48:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:48:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:48:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing instance network info cache due to event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:49:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:15 user nova-compute[75051]: DEBUG nova.network.neutron [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated VIF entry in instance network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:49:15 user nova-compute[75051]: DEBUG nova.network.neutron [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:49:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-2b05d347-b953-4311-ab0b-c8ea902325ac req-85710a3c-f9dc-416f-b57d-99fec4552e54 service nova] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:49:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:21 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:21 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:49:22 user nova-compute[75051]: INFO nova.compute.claims [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Claim successful on node user
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:49:22 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.policy [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666e4f4863444ec88e1f3acbe5a31c03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bad94fcdfedd4a2a930e0622ea9b6b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:49:22 user nova-compute[75051]: INFO nova.virt.block_device [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Booting with volume d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c at /dev/vda
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.utils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5d718-764b-4fe0-bc07-9c2474c22c83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[57894aef-f231-4a89-8dbe-d601eac423fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ce3947-282c-4000-8aeb-598ee95f5950]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c3352-4775-41a1-b5d9-5246a8d9c0cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:49:22 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:49:22 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2c0d6-c8f6-4d95-867f-b6f5ae817940]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG os_brick.utils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:49:22 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating existing volume attachment record: ffb5ff53-76ef-4b7e-8d75-25e1e4489d9b {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Successfully created port: 90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Successfully updated port: 90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquired lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG nova.compute.manager [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing instance network info cache due to event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:49:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] Acquiring lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG nova.network.neutron [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Releasing lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Instance network_info: |[{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] Acquired lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updated VIF entry in instance network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG nova.network.neutron [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-fd09fc3f-b940-41e4-b60b-42fdc2f8af56 req-12ebedce-b00b-44a9-9094-bdf169ecf325 service nova] Releasing lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:49:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:25 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:25 user nova-compute[75051]: WARNING nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Nov 24 19:49:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:49:25 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid da0d2efb-086a-4575-aca1-e60bb3726979 {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:49:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:25 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:49:28 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Creating image(s)
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Did not create local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Ensure instance console log exists: /opt/stack/data/nova/instances/da0d2efb-086a-4575-aca1-e60bb3726979/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Start _get_guest_xml network_info=[{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgaUkcVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da0d2efb-086a-4575-aca1-e60bb3726979', 'attached_at': '', 'detached_at': '', 'volume_id': 'd0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 'serial': 'd0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c'}, 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'ffb5ff53-76ef-4b7e-8d75-25e1e4489d9b', 'boot_index': 0, 'delete_on_termination': False, 'volume_type': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:49:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:49:28 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgaUkcVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:49:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:49:28 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:49:28 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[62418e5b-a93c-4a0e-b9e4-d636f33139da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:49:28 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cff9f6-b7f2-4a96-a99e-1d974d7724b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c] added
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d54bf6-5d45-4e71-8cee-20fccb062e80]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac1a288-f625-4003-93c8-306d9f8e78e0]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgaUkcVt {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgaUkcVt" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf4f8b-a0e4-455a-b2ca-8befdf27c0cc]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AgaUkcVt'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c32f0f-c289-4ace-b7d5-9ee6a2e605e6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f900f55f-a53b-44b9-99a0-bbb7065d22b3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[405374f9-5899-4294-9ec2-64ba9732ecb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260]
Nov 24 19:49:28 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260] successful.
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc930b9e-2ff5-43e2-8b89-d4ec8fe51372]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62daa0-ff90-4aa7-a0d9-6911b84e20d5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:49:28 user nova-compute[75051]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:49:28 user nova-compute[75051]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)
Nov 24 19:49:28 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3022336-202b-46ed-a681-dcbc5dcd4035]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:49:28 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgaUkcVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23134316661613137', 'path': '/dev/sdc'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134316661613137', 'path': '/dev/sdc'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-234213777',display_name='tempest-TestVolumeBootPattern-server-234213777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-234213777',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-lyo9iemw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:49:22Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=da0d2efb-086a-4575-aca1-e60bb3726979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.objects.instance [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'pci_devices' on Instance uuid da0d2efb-086a-4575-aca1-e60bb3726979 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:49:29 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:49:29 user nova-compute[75051]:   <uuid>da0d2efb-086a-4575-aca1-e60bb3726979</uuid>
Nov 24 19:49:29 user nova-compute[75051]:   <name>instance-00000034</name>
Nov 24 19:49:29 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:49:29 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:49:29 user nova-compute[75051]:   <metadata>
Nov 24 19:49:29 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:49:29 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:49:29 user nova-compute[75051]:       <nova:name>tempest-TestVolumeBootPattern-server-234213777</nova:name>
Nov 24 19:49:29 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:49:28</nova:creationTime>
Nov 24 19:49:29 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:49:29 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:49:29 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:49:29 user nova-compute[75051]:       <nova:owner>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:user uuid="666e4f4863444ec88e1f3acbe5a31c03">tempest-TestVolumeBootPattern-164541672-project-member</nova:user>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:project uuid="bad94fcdfedd4a2a930e0622ea9b6b5a">tempest-TestVolumeBootPattern-164541672</nova:project>
Nov 24 19:49:29 user nova-compute[75051]:       </nova:owner>
Nov 24 19:49:29 user nova-compute[75051]:       <nova:ports>
Nov 24 19:49:29 user nova-compute[75051]:         <nova:port uuid="90c0be2f-b32e-4852-8b10-9626bef7e039">
Nov 24 19:49:29 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 24 19:49:29 user nova-compute[75051]:         </nova:port>
Nov 24 19:49:29 user nova-compute[75051]:       </nova:ports>
Nov 24 19:49:29 user nova-compute[75051]:     </nova:instance>
Nov 24 19:49:29 user nova-compute[75051]:   </metadata>
Nov 24 19:49:29 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:49:29 user nova-compute[75051]:     <system>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="serial">da0d2efb-086a-4575-aca1-e60bb3726979</entry>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="uuid">da0d2efb-086a-4575-aca1-e60bb3726979</entry>
Nov 24 19:49:29 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:49:29 user nova-compute[75051]:     </system>
Nov 24 19:49:29 user nova-compute[75051]:   </sysinfo>
Nov 24 19:49:29 user nova-compute[75051]:   <os>
Nov 24 19:49:29 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:49:29 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:49:29 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:49:29 user nova-compute[75051]:   </os>
Nov 24 19:49:29 user nova-compute[75051]:   <features>
Nov 24 19:49:29 user nova-compute[75051]:     <acpi/>
Nov 24 19:49:29 user nova-compute[75051]:     <apic/>
Nov 24 19:49:29 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:49:29 user nova-compute[75051]:   </features>
Nov 24 19:49:29 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:49:29 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:49:29 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:49:29 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:49:29 user nova-compute[75051]:   </clock>
Nov 24 19:49:29 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:49:29 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:49:29 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:49:29 user nova-compute[75051]:   </cpu>
Nov 24 19:49:29 user nova-compute[75051]:   <devices>
Nov 24 19:49:29 user nova-compute[75051]:     <disk type="block" device="disk">
Nov 24 19:49:29 user nova-compute[75051]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:49:29 user nova-compute[75051]:       <source dev="/dev/sdc"/>
Nov 24 19:49:29 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:49:29 user nova-compute[75051]:       <serial>d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c</serial>
Nov 24 19:49:29 user nova-compute[75051]:     </disk>
Nov 24 19:49:29 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:49:29 user nova-compute[75051]:       <mac address="fa:16:3e:c0:05:eb"/>
Nov 24 19:49:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:49:29 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:49:29 user nova-compute[75051]:       <target dev="tap90c0be2f-b3"/>
Nov 24 19:49:29 user nova-compute[75051]:     </interface>
Nov 24 19:49:29 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:49:29 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/da0d2efb-086a-4575-aca1-e60bb3726979/console.log" append="off"/>
Nov 24 19:49:29 user nova-compute[75051]:     </serial>
Nov 24 19:49:29 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:49:29 user nova-compute[75051]:     <video>
Nov 24 19:49:29 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:49:29 user nova-compute[75051]:     </video>
Nov 24 19:49:29 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:49:29 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:49:29 user nova-compute[75051]:     </rng>
Nov 24 19:49:29 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:49:29 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:49:29 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:49:29 user nova-compute[75051]:     </memballoon>
Nov 24 19:49:29 user nova-compute[75051]:   </devices>
Nov 24 19:49:29 user nova-compute[75051]: </domain>
Nov 24 19:49:29 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-234213777',display_name='tempest-TestVolumeBootPattern-server-234213777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-234213777',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-lyo9iemw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:49:22Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=da0d2efb-086a-4575-aca1-e60bb3726979,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG os_vif [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea6f1bb3-1d50-5666-94ef-cae0148b1b62', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c0be2f-b3, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90c0be2f-b3, col_values=(('qos', UUID('77f063c3-b817-495e-bdf4-8e6db3c19aaf')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90c0be2f-b3, col_values=(('external_ids', {'iface-id': '90c0be2f-b32e-4852-8b10-9626bef7e039', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:05:eb', 'vm-uuid': 'da0d2efb-086a-4575-aca1-e60bb3726979'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:30 user nova-compute[75051]: INFO os_vif [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3')
Nov 24 19:49:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:49:30 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] No VIF found with MAC fa:16:3e:c0:05:eb, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:31 user nova-compute[75051]: DEBUG nova.compute.manager [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] No waiting events found dispatching network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:49:31 user nova-compute[75051]: WARNING nova.compute.manager [req-d6687944-6a64-4606-af5a-2fcf91b6afe5 req-93802c5b-534a-4c87-af28-79074ed09e2a service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received unexpected event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 for instance with vm_state building and task_state spawning.
Nov 24 19:49:31 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:49:33 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Instance spawned successfully.
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:49:33 user nova-compute[75051]: INFO nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG nova.compute.manager [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] No waiting events found dispatching network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:49:33 user nova-compute[75051]: WARNING nova.compute.manager [req-f44976c0-b140-4e71-9e2f-12cd7d15f6c3 req-68c07bd7-63d3-4c12-938e-0f20660d17c1 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received unexpected event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 for instance with vm_state building and task_state spawning.
Nov 24 19:49:33 user nova-compute[75051]: INFO nova.compute.manager [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Took 11.59 seconds to build instance.
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-988cdbe4-a27e-4326-ace0-ce74a844fe62 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.691s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.607s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:33 user nova-compute[75051]: INFO nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 24 19:49:33 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:49:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:49:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:49:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:49:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:56 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:49:57 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:49:57 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=25.158767700195312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance da0d2efb-086a-4575-aca1-e60bb3726979 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:49:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:49:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:50:00 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:50:01 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:50:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:50:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:50:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:50:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:50:50 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:50 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:50:52 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:50:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:50:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:50:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:50:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.158130645751953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance da0d2efb-086a-4575-aca1-e60bb3726979 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:50:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:51:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:51:01 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:51:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:51:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:51:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG nova.compute.manager [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing instance network info cache due to event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] Acquiring lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] Acquired lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:51:13 user nova-compute[75051]: DEBUG nova.network.neutron [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updated VIF entry in instance network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-543f071f-8be6-4265-9735-89914f1fb2c4 req-a71e5194-cea2-4032-b1a6-27425490197d service nova] Releasing lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:14 user nova-compute[75051]: INFO nova.compute.manager [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Terminating instance
Nov 24 19:51:14 user nova-compute[75051]: DEBUG nova.compute.manager [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-unplugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] No waiting events found dispatching network-vif-unplugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.compute.manager [req-26d13576-7a7a-4538-b2fb-6acaa0f0d84c req-a40868ab-4053-4a2a-99d0-1d46d9bdabf7 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-unplugged-90c0be2f-b32e-4852-8b10-9626bef7e039 for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Instance destroyed successfully.
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.objects.instance [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid da0d2efb-086a-4575-aca1-e60bb3726979 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:49:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-234213777',display_name='tempest-TestVolumeBootPattern-server-234213777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-234213777',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:49:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-lyo9iemw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:49:34Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=da0d2efb-086a-4575-aca1-e60bb3726979,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_vif [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c0be2f-b3, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77f063c3-b817-495e-bdf4-8e6db3c19aaf) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:15 user nova-compute[75051]: INFO os_vif [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:05:eb,bridge_name='br-int',has_traffic_filtering=True,id=90c0be2f-b32e-4852-8b10-9626bef7e039,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c0be2f-b3')
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgaUkcVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:51:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[20151fc6-6768-4c21-96a2-650daba92e19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:51:15 user nova-compute[75051]: No targets found.
Nov 24 19:51:15 user nova-compute[75051]: iSNS:
Nov 24 19:51:15 user nova-compute[75051]: No targets found.
Nov 24 19:51:15 user nova-compute[75051]: STATIC:
Nov 24 19:51:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c
Nov 24 19:51:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:51:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:51:15 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5
Nov 24 19:51:15 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:51:15 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:51:15 user nova-compute[75051]: FIRMWARE:
Nov 24 19:51:15 user nova-compute[75051]: No targets found.
Nov 24 19:51:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:51:15 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:51:15 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edca31d-04de-4b05-ac5c-8c3ba02ef025]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1a5b8-48ee-4808-98a4-41a5fcc6a4ea]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:51:15 user nova-compute[75051]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)
Nov 24 19:51:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:51:15 user nova-compute[75051]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c (non-flash)
Nov 24 19:51:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c38daa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c'): ({'sdc'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdc {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88945cd-a944-4148-b4e6-eb8854566cca]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[256279f9-b641-4e8d-86b0-bc7b8b96a5af]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdc {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3dfeea-f4ea-4630-a3f7-034badab9410]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3797e46e-bbfd-4955-ad97-4e2de96d7c65]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdc have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO521e8887-141faa170cd4d6a6', '/dev/disk/by-id/scsi-23134316661613137', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_521e8887') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a88863-a40f-43ed-bd78-71d0391b4003]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b791e-43b2-4490-b945-2c38786a45e9]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ef613-e0e8-4140-99c9-55a30aaccc4d]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260]
Nov 24 19:51:15 user nova-compute[75051]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c, portal: 172.16.0.220,3260] successful.
Nov 24 19:51:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0cd8d6b-8e5b-483b-b3a7-4bbc7ac93a4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44f7566-b5f1-4b61-b653-663fca78e63c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (307ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:51:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:51:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Deleting instance files /opt/stack/data/nova/instances/da0d2efb-086a-4575-aca1-e60bb3726979_del
Nov 24 19:51:15 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Deletion of /opt/stack/data/nova/instances/da0d2efb-086a-4575-aca1-e60bb3726979_del complete
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.compute.manager [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing instance network info cache due to event network-changed-90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] Acquiring lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] Acquired lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.network.neutron [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Refreshing network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:51:16 user nova-compute[75051]: INFO nova.compute.manager [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 24 19:51:16 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.network.neutron [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updated VIF entry in instance network info cache for port 90c0be2f-b32e-4852-8b10-9626bef7e039. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.network.neutron [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [{"id": "90c0be2f-b32e-4852-8b10-9626bef7e039", "address": "fa:16:3e:c0:05:eb", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c0be2f-b3", "ovs_interfaceid": "90c0be2f-b32e-4852-8b10-9626bef7e039", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-93c8cfd7-ffff-4262-85b4-c948c1bf34df req-3d05a470-0dad-4ca5-8b47-14fc29f8b1ff service nova] Releasing lock "refresh_cache-da0d2efb-086a-4575-aca1-e60bb3726979" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:51:16 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:51:16 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Took 0.45 seconds to deallocate network for instance.
Nov 24 19:51:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] Acquiring lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] Lock "da0d2efb-086a-4575-aca1-e60bb3726979-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] No waiting events found dispatching network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:51:17 user nova-compute[75051]: WARNING nova.compute.manager [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received unexpected event network-vif-plugged-90c0be2f-b32e-4852-8b10-9626bef7e039 for instance with vm_state active and task_state deleting.
Nov 24 19:51:17 user nova-compute[75051]: DEBUG nova.compute.manager [req-6fce13f4-5e29-4064-97bd-b4370c993159 req-fd07c794-5605-4900-8096-fd720fb43216 service nova] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Received event network-vif-deleted-90c0be2f-b32e-4852-8b10-9626bef7e039 {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:51:17 user nova-compute[75051]: INFO nova.compute.manager [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: da0d2efb-086a-4575-aca1-e60bb3726979] Took 0.72 seconds to detach 1 volumes for instance.
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:17 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance da0d2efb-086a-4575-aca1-e60bb3726979
Nov 24 19:51:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-20f0b354-0093-4bd3-a39a-70e10f4b8319 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "da0d2efb-086a-4575-aca1-e60bb3726979" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:20 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:25 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:35 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:45 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:51:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:51 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:51 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:51:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:55 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:51:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:51:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:51:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:51:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:51:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.157241821289062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:51:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:52:00 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:01 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:52:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:52:01 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:52:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:05 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.compute.manager [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing instance network info cache due to event network-changed-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] Acquiring lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] Acquired lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Refreshing network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:12 user nova-compute[75051]: INFO nova.compute.manager [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Terminating instance
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.compute.manager [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updated VIF entry in instance network info cache for port 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG nova.network.neutron [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [{"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ed39b51a-5aca-4052-9203-7b8258913a92 req-bbb277a3-d5f2-44d7-aa8c-0c89c434e398 service nova] Releasing lock "refresh_cache-44d1a6a7-26da-4d52-be5b-f6e801b67313" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:52:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Instance destroyed successfully.
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lazy-loading 'resources' on Instance uuid 44d1a6a7-26da-4d52-be5b-f6e801b67313 {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:47:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-744772481',display_name='tempest-TestVolumeBootPattern-server-744772481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-744772481',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODIP4hzHTjGfwmrooQo9JNWL2/fLA6++042bM8PUfBKHY2pB53IUUQjqOuzYphYhpbMQa2F301TIMJxax0c3PvCacBLntV198Uq4GIGklahSQoWRTfdK+3oIFPcWWgqFQ==',key_name='tempest-TestVolumeBootPattern-494279116',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:47:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bad94fcdfedd4a2a930e0622ea9b6b5a',ramdisk_id='',reservation_id='r-c0vhjd03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-164541672',owner_user_name='tempest-TestVolumeBootPattern-164541672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:47:34Z,user_data=None,user_id='666e4f4863444ec88e1f3acbe5a31c03',uuid=44d1a6a7-26da-4d52-be5b-f6e801b67313,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converting VIF {"id": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "address": "fa:16:3e:0d:12:57", "network": {"id": "c66c77e3-7787-4eeb-a113-be78730746da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1971820295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bad94fcdfedd4a2a930e0622ea9b6b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcb1dc3-81", "ovs_interfaceid": "0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_vif [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fcb1dc3-81, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6681103-67cb-4323-bcde-e19caf40a986) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:13 user nova-compute[75051]: INFO os_vif [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:12:57,bridge_name='br-int',has_traffic_filtering=True,id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c,network=Network(c66c77e3-7787-4eeb-a113-be78730746da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcb1dc3-81')
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZlVyTSkI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:52:13 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab66362-8644-487d-bb72-a711a1b3180d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:52:13 user nova-compute[75051]: No targets found.
Nov 24 19:52:13 user nova-compute[75051]: iSNS:
Nov 24 19:52:13 user nova-compute[75051]: No targets found.
Nov 24 19:52:13 user nova-compute[75051]: STATIC:
Nov 24 19:52:13 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5
Nov 24 19:52:13 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:52:13 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:52:13 user nova-compute[75051]: FIRMWARE:
Nov 24 19:52:13 user nova-compute[75051]: No targets found.
Nov 24 19:52:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:52:13 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:52:13 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd6a731-0ff4-4f47-83db-0b71d8b8099e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a779fb1-cae4-488a-bf00-219763ba6cc8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:52:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 (non-flash)
Nov 24 19:52:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a04371c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a136f5-a382-4c39-b3dd-2396367ba446]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d17e15-4faf-4700-9040-9588e544aa2c]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d7f2b-cd65-4743-952e-3e50fe75aa13]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c680a821-d651-4b7a-8e8b-bc2e163c5646]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8901a500-6028fc44a51f612f', '/dev/disk/by-id/scsi-23630323866633434', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8901a500') {{(pid=85538) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae489bd5-ad58-46fd-83b1-b59b32fe7f00]: (4, None) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b6631-3e4a-495f-8ed4-2da79b8a7562]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[867204ba-6375-4c44-b12b-9ad4e444fa95]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260]
Nov 24 19:52:13 user nova-compute[75051]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5, portal: 172.16.0.220,3260] successful.
Nov 24 19:52:13 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53fbed13-2e63-4a77-9692-616a49a102c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8a9e8b-9986-42cc-b302-2899e8251fba]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] <== disconnect_volume: return (320ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:52:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Deleting instance files /opt/stack/data/nova/instances/44d1a6a7-26da-4d52-be5b-f6e801b67313_del
Nov 24 19:52:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Deletion of /opt/stack/data/nova/instances/44d1a6a7-26da-4d52-be5b-f6e801b67313_del complete
Nov 24 19:52:13 user nova-compute[75051]: INFO nova.compute.manager [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 19:52:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:52:14 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Took 0.51 seconds to deallocate network for instance.
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-550052e2-6520-4f8f-92a2-e7188116a9d8 req-c0b97f3a-3416-4979-b13c-8bd69c174315 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-deleted-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:52:14 user nova-compute[75051]: INFO nova.compute.manager [req-550052e2-6520-4f8f-92a2-e7188116a9d8 req-c0b97f3a-3416-4979-b13c-8bd69c174315 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Neutron deleted interface 0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c; detaching it from the instance and deleting it from the info cache
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.network.neutron [req-550052e2-6520-4f8f-92a2-e7188116a9d8 req-c0b97f3a-3416-4979-b13c-8bd69c174315 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-550052e2-6520-4f8f-92a2-e7188116a9d8 req-c0b97f3a-3416-4979-b13c-8bd69c174315 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Detach interface failed, port_id=0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c, reason: Instance 44d1a6a7-26da-4d52-be5b-f6e801b67313 could not be found. {{(pid=75051) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-unplugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] No waiting events found dispatching network-vif-unplugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-unplugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Acquiring lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] No waiting events found dispatching network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:52:14 user nova-compute[75051]: WARNING nova.compute.manager [req-1db1a943-82bb-40a1-b74d-262f0c188b40 req-1bec75ed-f652-4f78-ab5f-2c5f21528ec6 service nova] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Received unexpected event network-vif-plugged-0fcb1dc3-81db-49dc-af6e-c0f9cdd5133c for instance with vm_state active and task_state deleting.
Nov 24 19:52:14 user nova-compute[75051]: INFO nova.compute.manager [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] [instance: 44d1a6a7-26da-4d52-be5b-f6e801b67313] Took 0.72 seconds to detach 1 volumes for instance.
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:52:14 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:15 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Deleted allocations for instance 44d1a6a7-26da-4d52-be5b-f6e801b67313
Nov 24 19:52:15 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-71a843c2-f10d-496e-853e-623bdbcfe096 tempest-TestVolumeBootPattern-164541672 tempest-TestVolumeBootPattern-164541672-project-member] Lock "44d1a6a7-26da-4d52-be5b-f6e801b67313" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:52:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:52:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:52:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:52:57 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:52:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:52:58 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=25.15636444091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:52:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:53:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:53:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 19:53:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:03 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:10 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:14 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:38 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:53:40 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:43 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:50 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:53:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:56 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Starting instance... {{(pid=75051) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75051) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 24 19:53:57 user nova-compute[75051]: INFO nova.compute.claims [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Claim successful on node user
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Start building networks asynchronously for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Allocating IP information in the background. {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] allocate_for_instance() {{(pid=75051) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 24 19:53:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Start building block device mappings for instance. {{(pid=75051) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.policy [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2aec05ddef524b0ea53b5d949cfccecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3872d888c26438d975a06808def6cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75051) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Start spawning the instance on the hypervisor. {{(pid=75051) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Creating instance directory {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 24 19:53:57 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Creating image(s)
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "/opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "/opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "/opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.242s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.181s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk 1073741824 {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451,backing_fmt=raw /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk 1073741824" returned: 0 in 0.052s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "e3bc8fa3335b675a52cc1936bd6e5f94dab0b451" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3bc8fa3335b675a52cc1936bd6e5f94dab0b451 --force-share --output=json" returned: 0 in 0.180s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk. size=1073741824 {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Successfully created port: 6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.virt.disk.api [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Cannot resize image /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk to a smaller size. {{(pid=75051) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Created local disks {{(pid=75051) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Ensure instance console log exists: /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/console.log {{(pid=75051) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:58 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Successfully updated port: 6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Building network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-changed-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.compute.manager [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Refreshing instance network info cache due to event network-changed-6927600b-8090-4bd3-b4b0-9e7467d8ddfa. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Instance cache missing network info. {{(pid=75051) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Instance network_info: |[{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75051) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Refreshing network info cache for port 6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Start _get_guest_xml network_info=[{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'encrypted': False, 'encryption_options': None, 'image_id': '5493a48f-5fd1-4417-ad27-dfb869ec17c2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 24 19:53:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:53:59 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CPU controller missing on host. {{(pid=75051) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.host [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CPU controller found on host. {{(pid=75051) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75051) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-24T18:48:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-24T18:48:30Z,direct_url=<?>,disk_format='qcow2',id=5493a48f-5fd1-4417-ad27-dfb869ec17c2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be2d2ee0c4dc49409908852df329de5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-24T18:48:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flavor limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Image limits 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flavor pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Image pref 0:0:0 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75051) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Got 1 possible topologies {{(pid=75051) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.hardware [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75051) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1728409686',display_name='tempest-SnapshotDataIntegrityTests-server-1728409686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1728409686',id=53,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFdYFxXWy3PajPlYu5iDJPgef+Q5295aV+F+bYkaWfqDuVgX9V6e83aPHIeg3yKpF4jMqMbwMj689KRYdMkHxb83doKCOAkqxhi93eoSC1pdXQWdTzpQEOsYQnDe1PH7Q==',key_name='tempest-keypair-1465345427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3872d888c26438d975a06808def6cb1',ramdisk_id='',reservation_id='r-efi5s3ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1591823232',owner_user_name='tempest-SnapshotDataIntegrityTests-1591823232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2aec05ddef524b0ea53b5d949cfccecb',uuid=d189f93a-b404-47ed-93f8-dac9f48fe6eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75051) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converting VIF {"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.objects.instance [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'pci_devices' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] End _get_guest_xml xml=<domain type="kvm">
Nov 24 19:53:59 user nova-compute[75051]:   <uuid>d189f93a-b404-47ed-93f8-dac9f48fe6eb</uuid>
Nov 24 19:53:59 user nova-compute[75051]:   <name>instance-00000035</name>
Nov 24 19:53:59 user nova-compute[75051]:   <memory>524288</memory>
Nov 24 19:53:59 user nova-compute[75051]:   <vcpu>1</vcpu>
Nov 24 19:53:59 user nova-compute[75051]:   <metadata>
Nov 24 19:53:59 user nova-compute[75051]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 24 19:53:59 user nova-compute[75051]:       <nova:package version="0.0.0"/>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1728409686</nova:name>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:creationTime>2023-11-24 19:53:59</nova:creationTime>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:flavor name="m1.tiny">
Nov 24 19:53:59 user nova-compute[75051]:         <nova:memory>512</nova:memory>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:disk>1</nova:disk>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:swap>0</nova:swap>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:ephemeral>0</nova:ephemeral>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:vcpus>1</nova:vcpus>
Nov 24 19:53:59 user nova-compute[75051]:       </nova:flavor>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:owner>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:user uuid="2aec05ddef524b0ea53b5d949cfccecb">tempest-SnapshotDataIntegrityTests-1591823232-project-member</nova:user>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:project uuid="e3872d888c26438d975a06808def6cb1">tempest-SnapshotDataIntegrityTests-1591823232</nova:project>
Nov 24 19:53:59 user nova-compute[75051]:       </nova:owner>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:root type="image" uuid="5493a48f-5fd1-4417-ad27-dfb869ec17c2"/>
Nov 24 19:53:59 user nova-compute[75051]:       <nova:ports>
Nov 24 19:53:59 user nova-compute[75051]:         <nova:port uuid="6927600b-8090-4bd3-b4b0-9e7467d8ddfa">
Nov 24 19:53:59 user nova-compute[75051]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 24 19:53:59 user nova-compute[75051]:         </nova:port>
Nov 24 19:53:59 user nova-compute[75051]:       </nova:ports>
Nov 24 19:53:59 user nova-compute[75051]:     </nova:instance>
Nov 24 19:53:59 user nova-compute[75051]:   </metadata>
Nov 24 19:53:59 user nova-compute[75051]:   <sysinfo type="smbios">
Nov 24 19:53:59 user nova-compute[75051]:     <system>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="product">OpenStack Nova</entry>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="version">0.0.0</entry>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="serial">d189f93a-b404-47ed-93f8-dac9f48fe6eb</entry>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="uuid">d189f93a-b404-47ed-93f8-dac9f48fe6eb</entry>
Nov 24 19:53:59 user nova-compute[75051]:       <entry name="family">Virtual Machine</entry>
Nov 24 19:53:59 user nova-compute[75051]:     </system>
Nov 24 19:53:59 user nova-compute[75051]:   </sysinfo>
Nov 24 19:53:59 user nova-compute[75051]:   <os>
Nov 24 19:53:59 user nova-compute[75051]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 24 19:53:59 user nova-compute[75051]:     <boot dev="hd"/>
Nov 24 19:53:59 user nova-compute[75051]:     <smbios mode="sysinfo"/>
Nov 24 19:53:59 user nova-compute[75051]:   </os>
Nov 24 19:53:59 user nova-compute[75051]:   <features>
Nov 24 19:53:59 user nova-compute[75051]:     <acpi/>
Nov 24 19:53:59 user nova-compute[75051]:     <apic/>
Nov 24 19:53:59 user nova-compute[75051]:     <vmcoreinfo/>
Nov 24 19:53:59 user nova-compute[75051]:   </features>
Nov 24 19:53:59 user nova-compute[75051]:   <clock offset="utc">
Nov 24 19:53:59 user nova-compute[75051]:     <timer name="pit" tickpolicy="delay"/>
Nov 24 19:53:59 user nova-compute[75051]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 24 19:53:59 user nova-compute[75051]:     <timer name="hpet" present="no"/>
Nov 24 19:53:59 user nova-compute[75051]:   </clock>
Nov 24 19:53:59 user nova-compute[75051]:   <cpu mode="custom" match="exact">
Nov 24 19:53:59 user nova-compute[75051]:     <model>Nehalem</model>
Nov 24 19:53:59 user nova-compute[75051]:     <topology sockets="1" cores="1" threads="1"/>
Nov 24 19:53:59 user nova-compute[75051]:   </cpu>
Nov 24 19:53:59 user nova-compute[75051]:   <devices>
Nov 24 19:53:59 user nova-compute[75051]:     <disk type="file" device="disk">
Nov 24 19:53:59 user nova-compute[75051]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 24 19:53:59 user nova-compute[75051]:       <source file="/opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk"/>
Nov 24 19:53:59 user nova-compute[75051]:       <target dev="vda" bus="virtio"/>
Nov 24 19:53:59 user nova-compute[75051]:     </disk>
Nov 24 19:53:59 user nova-compute[75051]:     <interface type="ethernet">
Nov 24 19:53:59 user nova-compute[75051]:       <mac address="fa:16:3e:61:7e:c0"/>
Nov 24 19:53:59 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:53:59 user nova-compute[75051]:       <mtu size="1442"/>
Nov 24 19:53:59 user nova-compute[75051]:       <target dev="tap6927600b-80"/>
Nov 24 19:53:59 user nova-compute[75051]:     </interface>
Nov 24 19:53:59 user nova-compute[75051]:     <serial type="pty">
Nov 24 19:53:59 user nova-compute[75051]:       <log file="/opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/console.log" append="off"/>
Nov 24 19:53:59 user nova-compute[75051]:     </serial>
Nov 24 19:53:59 user nova-compute[75051]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 24 19:53:59 user nova-compute[75051]:     <video>
Nov 24 19:53:59 user nova-compute[75051]:       <model type="virtio"/>
Nov 24 19:53:59 user nova-compute[75051]:     </video>
Nov 24 19:53:59 user nova-compute[75051]:     <rng model="virtio">
Nov 24 19:53:59 user nova-compute[75051]:       <backend model="random">/dev/urandom</backend>
Nov 24 19:53:59 user nova-compute[75051]:     </rng>
Nov 24 19:53:59 user nova-compute[75051]:     <controller type="usb" index="0" model="none"/>
Nov 24 19:53:59 user nova-compute[75051]:     <memballoon model="virtio">
Nov 24 19:53:59 user nova-compute[75051]:       <stats period="10"/>
Nov 24 19:53:59 user nova-compute[75051]:     </memballoon>
Nov 24 19:53:59 user nova-compute[75051]:   </devices>
Nov 24 19:53:59 user nova-compute[75051]: </domain>
Nov 24 19:53:59 user nova-compute[75051]:  {{(pid=75051) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1728409686',display_name='tempest-SnapshotDataIntegrityTests-server-1728409686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1728409686',id=53,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFdYFxXWy3PajPlYu5iDJPgef+Q5295aV+F+bYkaWfqDuVgX9V6e83aPHIeg3yKpF4jMqMbwMj689KRYdMkHxb83doKCOAkqxhi93eoSC1pdXQWdTzpQEOsYQnDe1PH7Q==',key_name='tempest-keypair-1465345427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3872d888c26438d975a06808def6cb1',ramdisk_id='',reservation_id='r-efi5s3ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1591823232',owner_user_name='tempest-SnapshotDataIntegrityTests-1591823232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-24T19:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2aec05ddef524b0ea53b5d949cfccecb',uuid=d189f93a-b404-47ed-93f8-dac9f48fe6eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converting VIF {"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG os_vif [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80') {{(pid=75051) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c50d7097-d410-5d8c-b8c7-ebd63e27ba20', '_type': 'linux-noop'}}, row=False) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6927600b-80, may_exist=True, interface_attrs={}) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6927600b-80, col_values=(('qos', UUID('87ef842a-3f54-4441-851d-618dc6479e18')),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6927600b-80, col_values=(('external_ids', {'iface-id': '6927600b-8090-4bd3-b4b0-9e7467d8ddfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:7e:c0', 'vm-uuid': 'd189f93a-b404-47ed-93f8-dac9f48fe6eb'}),), if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:53:59 user nova-compute[75051]: INFO os_vif [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80')
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No VIF found with MAC fa:16:3e:61:7e:c0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated VIF entry in instance network info cache for port 6927600b-8090-4bd3-b4b0-9e7467d8ddfa. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.network.neutron [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:53:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-087c596d-5759-4272-8adc-2189c2dc9fa5 req-9d0d14c6-ee16-4502-a697-6676bbc4f65a service nova] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG nova.compute.manager [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] No waiting events found dispatching network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:54:01 user nova-compute[75051]: WARNING nova.compute.manager [req-6bce4c40-20db-4d00-8a81-15722f5674ee req-26eb7adc-570a-4b52-b4ee-aa8c6e0b1165 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received unexpected event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa for instance with vm_state building and task_state spawning.
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:54:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:54:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.141494750976562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:54:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.compute.manager [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] No waiting events found dispatching network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 19:54:03 user nova-compute[75051]: WARNING nova.compute.manager [req-41dd2c12-7da7-4588-a134-ad930e8b8b03 req-05609348-e6dd-449e-88c5-5fda0414db98 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received unexpected event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa for instance with vm_state building and task_state spawning.
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Instance event wait completed in 0 seconds for  {{(pid=75051) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Guest created on hypervisor {{(pid=75051) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 24 19:54:03 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Instance spawned successfully.
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_cdrom_bus of ide {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_disk_bus of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_input_bus of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_pointer_model of None {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_video_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Found default for hw_vif_model of virtio {{(pid=75051) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 24 19:54:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:03 user nova-compute[75051]: INFO nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 24 19:54:03 user nova-compute[75051]: DEBUG nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Checking state {{(pid=75051) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 24 19:54:03 user nova-compute[75051]: INFO nova.compute.manager [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Took 6.65 seconds to build instance.
Nov 24 19:54:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-ddbcf4e2-c571-48c3-b8bf-8bc2c5ff003a tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.775s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:54:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:54:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:54:06 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:54:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:54:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:54:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:19 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:41 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:54:42 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:54 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:54:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:00 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:55:00 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.11037826538086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 19:55:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 19:55:01 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:55:01 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:55:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:55:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:55:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:55:04 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:55:05 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:55:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:55:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:55:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:55:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-changed-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 19:55:47 user nova-compute[75051]: DEBUG nova.compute.manager [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Refreshing instance network info cache due to event network-changed-6927600b-8090-4bd3-b4b0-9e7467d8ddfa. {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 24 19:55:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:55:47 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:55:47 user nova-compute[75051]: DEBUG nova.network.neutron [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Refreshing network info cache for port 6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 24 19:55:48 user nova-compute[75051]: DEBUG nova.network.neutron [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated VIF entry in instance network info cache for port 6927600b-8090-4bd3-b4b0-9e7467d8ddfa. {{(pid=75051) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 24 19:55:48 user nova-compute[75051]: DEBUG nova.network.neutron [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:55:48 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-36e4424d-bae8-4dfa-8c67-c3985cb2313e req-daf75876-88a8-4089-99ee-94ffd3821c80 service nova] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:55:48 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:55:51 user nova-compute[75051]: INFO nova.compute.manager [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attaching volume 57500789-e9bb-44c5-bbbb-b85ffc921491 to /dev/vdb
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.utils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db98f20-69de-45ae-b514-836e9444c26c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c32e1-ca8f-472f-afc2-9c2c01b30627]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0602092a-b480-478f-a8fd-bddd1446ae3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fadd9-273a-4aea-96d7-c7d083a97ee0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:55:51 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:55:51 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d1d7c8-9239-4bc5-bf60-fc3088b59e20]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG os_brick.utils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:55:51 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating existing volume attachment record: f9f0d1ad-16d9-442a-a1aa-2c9a380a97e4 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:55:53 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQzlRgyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:55:57 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:55:57 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:55:57 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6e578-2586-4530-94fc-03b27b65eb15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:55:57 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d8accf-78ae-4a79-b152-7e962830fd5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491] added
Nov 24 19:55:57 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[36695851-6ea7-4361-b33d-f8179cd91685]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92c156-2909-4591-9497-07b723945f92]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQzlRgyw {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VQzlRgyw" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1342a-86f2-4753-bcf2-9885d8b176ac]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VQzlRgyw'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753546b-bc58-4454-95d6-3f8aa603d946]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5708c3-4e39-4411-89be-6cc81c00d48d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:55:57 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:55:57 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:55:57 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:55:57 user nova-compute[75051]: 
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf884cf-de19-4449-8538-b8fb0a7bb629]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260]
Nov 24 19:55:57 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260] successful.
Nov 24 19:55:57 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[863dfbb0-f890-46f7-a817-dbb8a609bd8b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a10cb-7f5c-4c66-b77c-347d1d34342c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)
Nov 24 19:55:57 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)
Nov 24 19:55:57 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d6d0c-243d-4bb3-8ac2-968c59fa97b1]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:55:57 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQzlRgyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26663646465623761', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663646465623761', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:55:58 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:55:58 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:55:58 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:55:58 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:55:58 user nova-compute[75051]:   <serial>57500789-e9bb-44c5-bbbb-b85ffc921491</serial>
Nov 24 19:55:58 user nova-compute[75051]: </disk>
Nov 24 19:55:58 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No VIF found with MAC fa:16:3e:61:7e:c0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6cb8bc32-8833-406d-aa88-de884a17a12b tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.926s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:55:59 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75051) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 24 19:56:00 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:56:00 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=25.109424591064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:56:00 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:56:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:03 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:56:04 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:56:05 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:56:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:56:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:56:13 user nova-compute[75051]: INFO nova.compute.manager [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Detaching volume 57500789-e9bb-44c5-bbbb-b85ffc921491
Nov 24 19:56:13 user nova-compute[75051]: INFO nova.virt.block_device [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attempting to driver detach volume 57500789-e9bb-44c5-bbbb-b85ffc921491 from mountpoint /dev/vdb
Nov 24 19:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Attempting to detach device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:56:13 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:56:13 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:56:13 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:56:13 user nova-compute[75051]:   <serial>57500789-e9bb-44c5-bbbb-b85ffc921491</serial>
Nov 24 19:56:13 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:56:13 user nova-compute[75051]: </disk>
Nov 24 19:56:13 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:56:13 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config.
Nov 24 19:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:56:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:56:13 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:56:13 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:56:13 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:56:13 user nova-compute[75051]:   <serial>57500789-e9bb-44c5-bbbb-b85ffc921491</serial>
Nov 24 19:56:13 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:56:13 user nova-compute[75051]: </disk>
Nov 24 19:56:13 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:56:14 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:56:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:34 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb is timed out.
Nov 24 19:56:34 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config.
Nov 24 19:56:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VQzlRgyw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:56:34 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e6cec2-98c1-49da-b3d1-1fd3f59d786b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:56:34 user nova-compute[75051]: No targets found.
Nov 24 19:56:34 user nova-compute[75051]: iSNS:
Nov 24 19:56:34 user nova-compute[75051]: No targets found.
Nov 24 19:56:34 user nova-compute[75051]: STATIC:
Nov 24 19:56:34 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491
Nov 24 19:56:34 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:56:34 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:56:34 user nova-compute[75051]: FIRMWARE:
Nov 24 19:56:34 user nova-compute[75051]: No targets found.
Nov 24 19:56:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:56:34 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:56:34 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c48ee8-6173-4582-9512-1f5570eeb1ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4068dfc-bd11-4586-b165-cafd8407c094]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)
Nov 24 19:56:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 (non-flash)
Nov 24 19:56:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6b83512d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[70213c33-90b6-4c79-a90c-e9a16ef70aa3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[643ef104-f117-435e-a170-76f89730b491]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f232bef0-a9d9-48f5-934f-15fe08b956aa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[da03e223-4e34-49c2-9339-0ecbe464082d]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e859930-c129-41b2-9993-c260b106641e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5cda6c-6e4a-4ed9-b73e-2fb2b90ef5da]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260]
Nov 24 19:56:34 user nova-compute[75051]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491, portal: 172.16.0.220,3260] successful.
Nov 24 19:56:34 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57500789-e9bb-44c5-bbbb-b85ffc921491 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a32b51-dd10-4274-ae3f-8c01105936b1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== disconnect_volume: return (276ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:56:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:35 user nova-compute[75051]: DEBUG nova.objects.instance [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:56:35 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-b8fbb9d2-cda6-4400-a6ce-c422a328820d tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:56:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:56:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:56:55 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:55 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:56:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:56:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:57:01 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:57:02 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:57:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.108463287353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:57:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:57:03 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:57:03 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:57:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:57:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG nova.objects.instance [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:57:05 user nova-compute[75051]: INFO nova.compute.manager [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attaching volume 2a4da68e-6a37-475f-844c-8704e57e44bc to /dev/vdb
Nov 24 19:57:05 user nova-compute[75051]: DEBUG os_brick.utils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb549a9f-d930-4df4-8216-5648f5275078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb9b2b-e4aa-4aa2-9139-e9558b12d5df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[89635fff-da32-4ecd-8f91-69be858ec56b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[104095d4-2406-4300-b199-df28148eaa2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:57:06 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380ebf2-6ed3-4d41-a54b-ab753fbb99b0]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG os_brick.utils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating existing volume attachment record: f45bddce-6e50-49f5-b52b-15987313368e {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:57:06 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:57:07 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:57:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:57:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:57:08 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKyJjMPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:57:11 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:57:11 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:57:11 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca722e3-a428-4f31-9053-87985d9aa689]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:57:11 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed7b7f-824c-4008-9d53-57b457828ef7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc] added
Nov 24 19:57:11 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9afd75-50fd-4964-9f24-5271ad902226]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.054s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0941f7ca-c24c-4038-99d1-ab346f10b0ff]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKyJjMPE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GKyJjMPE" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b93ed8-1355-479a-b49d-b2f291332aab]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GKyJjMPE'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[22371014-5698-4588-8032-525944480f44]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbd3e11-bb49-4424-98c2-8ccb5c2ca66f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:57:11 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:57:11 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:57:11 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:57:11 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:57:11 user nova-compute[75051]: 
Nov 24 19:57:11 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b43a81-eb37-41d4-bcab-c904844b723b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260]
Nov 24 19:57:12 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260] successful.
Nov 24 19:57:12 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb0da2b-f298-4ce8-95bc-050d780e95c6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a178759f-36a0-4cc0-9b10-65884afad9cc]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)
Nov 24 19:57:12 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)
Nov 24 19:57:12 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a444d6a6-9809-4352-80c9-7bee6d1e9160]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:57:12 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKyJjMPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26465633065323866', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465633065323866', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.objects.instance [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:57:13 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:57:13 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:57:13 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:57:13 user nova-compute[75051]:   <serial>2a4da68e-6a37-475f-844c-8704e57e44bc</serial>
Nov 24 19:57:13 user nova-compute[75051]: </disk>
Nov 24 19:57:13 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No VIF found with MAC fa:16:3e:61:7e:c0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-65f442bb-3f48-4662-a816-2b589809b4e4 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.826s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:57:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:57:16 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:57:16 user nova-compute[75051]: INFO nova.compute.manager [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Detaching volume 2a4da68e-6a37-475f-844c-8704e57e44bc
Nov 24 19:57:16 user nova-compute[75051]: INFO nova.virt.block_device [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attempting to driver detach volume 2a4da68e-6a37-475f-844c-8704e57e44bc from mountpoint /dev/vdb
Nov 24 19:57:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Attempting to detach device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:57:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:57:16 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:57:16 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:57:16 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:57:16 user nova-compute[75051]:   <serial>2a4da68e-6a37-475f-844c-8704e57e44bc</serial>
Nov 24 19:57:16 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:57:16 user nova-compute[75051]: </disk>
Nov 24 19:57:16 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:57:16 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config.
Nov 24 19:57:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:57:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:57:16 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:57:16 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:57:16 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:57:16 user nova-compute[75051]:   <serial>2a4da68e-6a37-475f-844c-8704e57e44bc</serial>
Nov 24 19:57:16 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:57:16 user nova-compute[75051]: </disk>
Nov 24 19:57:16 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:57:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:57:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:36 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb is timed out.
Nov 24 19:57:36 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config.
Nov 24 19:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GKyJjMPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:57:36 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a87b03-029d-4a21-bd4b-75abbbd2c378]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:57:36 user nova-compute[75051]: No targets found.
Nov 24 19:57:36 user nova-compute[75051]: iSNS:
Nov 24 19:57:36 user nova-compute[75051]: No targets found.
Nov 24 19:57:36 user nova-compute[75051]: STATIC:
Nov 24 19:57:36 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc
Nov 24 19:57:36 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:57:36 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:57:36 user nova-compute[75051]: FIRMWARE:
Nov 24 19:57:36 user nova-compute[75051]: No targets found.
Nov 24 19:57:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:57:36 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:57:36 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a88b00-8720-4fe7-8a21-349ec395e75f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7eab47-e3cc-43e5-92c6-7b7cacff8c34]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)
Nov 24 19:57:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc (non-flash)
Nov 24 19:57:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a03e32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e1c666-3cb0-45c0-987e-a047e7036ed2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d976825-6545-428a-a4ce-30a6a946f62b]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b29dfb-7491-4631-9c4d-6ee6d921196b]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00486f2-ea42-479d-b246-fb32d6fc3d94]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3900b5b-b63a-4f3a-af13-dda07c2cf0f1]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6beccd-d806-44d9-819d-4b9513fccc0d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260]
Nov 24 19:57:36 user nova-compute[75051]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc, portal: 172.16.0.220,3260] successful.
Nov 24 19:57:36 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a4da68e-6a37-475f-844c-8704e57e44bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd262a4-f08c-4f2a-9aaf-f31adbad8daa]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== disconnect_volume: return (289ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:57:36 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:57:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:57:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-effeb7c8-150b-4b0b-b5d3-7e048f3b5c17 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.562s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:57:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:57:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:57:56 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:57:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:58:02 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:03 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:58:03 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.107463836669922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:58:03 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:58:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:58:06 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:58:07 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:58:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:58:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:58:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:58:09 user nova-compute[75051]: INFO nova.compute.manager [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attaching volume 5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a to /dev/vdb
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.utils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a9fbe7-b686-446a-967c-4f9e8a3ad0e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[29569f78-d7ac-46cf-8223-b58cc1f9d93d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60efe2d-8d58-42d7-a4ce-03458b5711b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4799140-a293-4cc0-8af7-6d73a55de701]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:58:09 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:58:09 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fd832-2b2a-41ce-b57e-a2fa869124db]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG os_brick.utils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating existing volume attachment record: ebc7efaf-2c90-4008-b9e3-f4703f43447b {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:58:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:14 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgdMGTtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:58:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:58:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:58:15 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6edd6-9342-40fe-8425-c86680017af8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:58:15 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2d1451-58b0-468c-ad9a-5f445eac8bbb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a] added
Nov 24 19:58:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a59c798-f3e4-4782-b5c5-898313feaa8c]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05db5f-0be7-4372-83d0-14a1164f7a17]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgdMGTtw {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgdMGTtw" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b0338-7f14-4a03-a86a-6f4fe21d5b45]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgdMGTtw'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c2dcd-8cc3-4778-b88a-7e7a55877de5]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4724b5c-72fe-4d6f-8f00-3001db69a67e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:58:15 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:58:15 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:58:15 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:58:15 user nova-compute[75051]: 
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3bfff8-f9d6-42ff-9cea-176b6477a274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260]
Nov 24 19:58:15 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260] successful.
Nov 24 19:58:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[68acea21-aaa9-4848-a20b-c294dbde1938]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[633f7152-25cb-4860-aeaf-49a18d0cf692]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)
Nov 24 19:58:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)
Nov 24 19:58:15 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bee5c9-13b2-46ad-b732-923b7e159a4e]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:58:15 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgdMGTtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26263396261656433', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263396261656433', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:58:16 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:58:16 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:58:16 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:58:16 user nova-compute[75051]:   <serial>5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a</serial>
Nov 24 19:58:16 user nova-compute[75051]: </disk>
Nov 24 19:58:16 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:58:16 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No VIF found with MAC fa:16:3e:61:7e:c0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:58:17 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9be11d41-7a96-44b3-9175-7a522095a2eb tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.714s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:58:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:18 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:58:19 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:58:19 user nova-compute[75051]: INFO nova.compute.manager [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Detaching volume 5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a
Nov 24 19:58:19 user nova-compute[75051]: INFO nova.virt.block_device [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attempting to driver detach volume 5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a from mountpoint /dev/vdb
Nov 24 19:58:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Attempting to detach device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:58:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:58:19 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:58:19 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:58:19 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:58:19 user nova-compute[75051]:   <serial>5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a</serial>
Nov 24 19:58:19 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:58:19 user nova-compute[75051]: </disk>
Nov 24 19:58:19 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:58:19 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config.
Nov 24 19:58:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:58:19 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:58:19 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:58:19 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:58:19 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:58:19 user nova-compute[75051]:   <serial>5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a</serial>
Nov 24 19:58:19 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:58:19 user nova-compute[75051]: </disk>
Nov 24 19:58:19 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:58:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:58:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:58:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:40 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb is timed out.
Nov 24 19:58:40 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config.
Nov 24 19:58:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgdMGTtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:58:40 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd69deb-d2f0-4e28-bbd4-b85a1111254d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:58:40 user nova-compute[75051]: No targets found.
Nov 24 19:58:40 user nova-compute[75051]: iSNS:
Nov 24 19:58:40 user nova-compute[75051]: No targets found.
Nov 24 19:58:40 user nova-compute[75051]: STATIC:
Nov 24 19:58:40 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a
Nov 24 19:58:40 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:58:40 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:58:40 user nova-compute[75051]: FIRMWARE:
Nov 24 19:58:40 user nova-compute[75051]: No targets found.
Nov 24 19:58:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:58:40 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:58:40 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0aa650-33b9-40af-83cb-baf5267adb4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2fa1dc-7e94-4477-ba32-02a6c65a73c2]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)
Nov 24 19:58:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a (non-flash)
Nov 24 19:58:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6c01a2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be6f64-7b36-49d6-90af-e45ad9cd1c79]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15628fc-8614-43a9-865b-84f88bfee2cf]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb54a1a-f3f1-4726-b2b8-ad75734df623]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94b036-e390-40cf-a104-3511103fcbf3]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[475da596-fe63-481a-9d4e-15e5e47be97a]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c6c6c-5ea0-45d2-9cc3-c297cca3cc2f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260]
Nov 24 19:58:40 user nova-compute[75051]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a, portal: 172.16.0.220,3260] successful.
Nov 24 19:58:40 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fe426b3-c4fe-4ef0-9e46-568c41a4eb3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc731f8-1541-4ce4-ac85-a2eecf1ec24e]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== disconnect_volume: return (276ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:58:40 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:58:41 user nova-compute[75051]: DEBUG nova.objects.instance [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:58:41 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-006054be-3186-477d-aa1f-6a40d6f8ac4c tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.610s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:58:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:58:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:58:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:58:56 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:58:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:58:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75051) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:04 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:05 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:59:05 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.106491088867188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 19:59:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 19:59:08 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:59:09 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 19:59:09 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 19:59:09 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 19:59:09 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:12 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:59:12 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:13 user nova-compute[75051]: INFO nova.compute.manager [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attaching volume be7d8fc2-fd16-4b8c-9c86-b7be0223269b to /dev/vdb
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.utils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cf4c4-fff5-4a79-9dd8-ce17560c8897]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:daa7e44516a1\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[122de532-65cc-4fb0-a7e8-99bf69f85e5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c4803-43b1-42a6-ac11-d2c68425194f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ab8a5c-3cb2-4d35-ad63-890a77cb915f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Running cmd (subprocess): nvme version {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] 'nvme version' failed. Not Retrying. {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] nvme not present on system {{(pid=75051) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 24 19:59:13 user nova-compute[75051]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702780b-f363-49f1-9ca5-d9967b9fb5d4]: (4, '') {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75051) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.lightos [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] LIGHTOS: no hostnqn found. {{(pid=75051) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG os_brick.utils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:daa7e44516a1', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG nova.virt.block_device [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating existing volume attachment record: fdd49f0c-9114-43b0-a14f-b0708ef09d57 {{(pid=75051) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:13 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Calling os-brick to attach iSCSI Volume {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyzDMBfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:59:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:59:18 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:59:18 user nova-compute[75051]: INFO os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a51805-2a5c-4282-afd8-09da4fe54d7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 24 19:59:18 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --interface default --op new {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc4e13-52ac-4708-a849-0cdbe266c50e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b] added\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b] added
Nov 24 19:59:18 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1926ef03-2b05-468e-b267-412fbdc812e4]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[286f4066-f193-4169-850c-234b7b90f0c6]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyzDMBfI {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyzDMBfI" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab8725e-f3d9-4063-9a01-4a3ec9e0bc11]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XyzDMBfI'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:18 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[938fff01-e350-462e-ac09-fef912e4f8cf]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb978ee-ca07-4955-83ae-1c882ee91915]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:59:19 user nova-compute[75051]:  {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 24 19:59:19 user nova-compute[75051]:  {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:59:19 user nova-compute[75051]: WARNING os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 24 19:59:19 user nova-compute[75051]: 
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --login {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bbe37-fc63-4a63-b4a8-603032b1a595]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260]
Nov 24 19:59:19 user nova-compute[75051]: Login to [iface: default, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260] successful.
Nov 24 19:59:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68d5340-c61a-4751-ba7c-1df6ed090541]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[47926dee-41c9-4c0b-88d8-a8ba4518bc67]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)
Nov 24 19:59:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)
Nov 24 19:59:19 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to 172.16.0.220:3260 {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75051) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75051) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[420323f8-aa10-4079-a71e-6b4b0fcd4413]: (4, ('- - 0', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75051) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyzDMBfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75051) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 24 19:59:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23034343131376333', 'path': '/dev/sdb'} {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343131376333', 'path': '/dev/sdb'} {{(pid=75051) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.objects.instance [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] attach device xml: <disk type="block" device="disk">
Nov 24 19:59:20 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:59:20 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:59:20 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:59:20 user nova-compute[75051]:   <serial>be7d8fc2-fd16-4b8c-9c86-b7be0223269b</serial>
Nov 24 19:59:20 user nova-compute[75051]: </disk>
Nov 24 19:59:20 user nova-compute[75051]:  {{(pid=75051) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vda, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75051) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] No VIF found with MAC fa:16:3e:61:7e:c0, not building metadata {{(pid=75051) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-d6917f12-32d5-4124-b0e0-619f0ae89cf5 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.661s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:23 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:23 user nova-compute[75051]: INFO nova.compute.manager [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Detaching volume be7d8fc2-fd16-4b8c-9c86-b7be0223269b
Nov 24 19:59:23 user nova-compute[75051]: INFO nova.virt.block_device [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Attempting to driver detach volume be7d8fc2-fd16-4b8c-9c86-b7be0223269b from mountpoint /dev/vdb
Nov 24 19:59:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Attempting to detach device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config. {{(pid=75051) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 24 19:59:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:59:23 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:59:23 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:59:23 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:59:23 user nova-compute[75051]:   <serial>be7d8fc2-fd16-4b8c-9c86-b7be0223269b</serial>
Nov 24 19:59:23 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:59:23 user nova-compute[75051]: </disk>
Nov 24 19:59:23 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:59:23 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:23 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the persistent domain config.
Nov 24 19:59:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config. {{(pid=75051) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 24 19:59:23 user nova-compute[75051]: DEBUG nova.virt.libvirt.guest [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] detach device xml: <disk type="block" device="disk">
Nov 24 19:59:23 user nova-compute[75051]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 24 19:59:23 user nova-compute[75051]:   <source dev="/dev/sdb"/>
Nov 24 19:59:23 user nova-compute[75051]:   <target dev="vdb" bus="virtio"/>
Nov 24 19:59:23 user nova-compute[75051]:   <serial>be7d8fc2-fd16-4b8c-9c86-b7be0223269b</serial>
Nov 24 19:59:23 user nova-compute[75051]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 24 19:59:23 user nova-compute[75051]: </disk>
Nov 24 19:59:23 user nova-compute[75051]:  {{(pid=75051) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 24 19:59:24 user nova-compute[75051]: DEBUG nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 24 19:59:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:26 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:26 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Triggering sync for uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 24 19:59:26 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 19:59:28 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:39 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:44 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb is timed out.
Nov 24 19:59:44 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully detached device vdb from instance d189f93a-b404-47ed-93f8-dac9f48fe6eb from the live domain config.
Nov 24 19:59:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] calling os-brick to detach iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff6c02a7400>, {'target_iqn': 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyzDMBfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 24 19:59:44 user nova-compute[75051]: WARNING os_brick.initiator.connectors.base [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da5abdb-59ff-4a7f-a252-e3b79438947f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 24 19:59:44 user nova-compute[75051]: No targets found.
Nov 24 19:59:44 user nova-compute[75051]: iSNS:
Nov 24 19:59:44 user nova-compute[75051]: No targets found.
Nov 24 19:59:44 user nova-compute[75051]: STATIC:
Nov 24 19:59:44 user nova-compute[75051]: Target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b
Nov 24 19:59:44 user nova-compute[75051]:         Portal: 172.16.0.220:3260,-1
Nov 24 19:59:44 user nova-compute[75051]:                 Iface Name: default
Nov 24 19:59:44 user nova-compute[75051]: FIRMWARE:
Nov 24 19:59:44 user nova-compute[75051]: No targets found.
Nov 24 19:59:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 24 19:59:44 user nova-compute[75051]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 24 19:59:44 user nova-compute[75051]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75051) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b', 0)] {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cbcacc-f676-4e78-a799-0b1086c1cee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c71da-308b-470d-b1b1-f29f7cbf9931]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)
Nov 24 19:59:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b (non-flash)
Nov 24 19:59:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6a04bc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b'): ({'sdb'}, set())}) {{(pid=75051) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Removing single pathed devices sdb {{(pid=75051) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab49c04-bfeb-4908-a33f-053182cdc234]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[999b10f6-ff7e-4519-9947-fd0495dcda14]: (4, ('ok\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Flushing IO for device /dev/sdb {{(pid=75051) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d02a2a-6d4e-457a-b5b9-f8baed8cff38]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75051) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbd4f70-913a-4681-a09c-fb42b6f4482d]: (4, ('1', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.linuxscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] SCSI volumes sdb have been removed. {{(pid=75051) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b')] {{(pid=75051) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b29fd0-75ce-4334-b3c1-e53b0960e7b8]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --logout {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ee01a-e6b0-48f6-bcc7-e5270834499e]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260]
Nov 24 19:59:44 user nova-compute[75051]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b, portal: 172.16.0.220,3260] successful.
Nov 24 19:59:44 user nova-compute[75051]:  stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op delete {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7d8fc2-fd16-4b8c-9c86-b7be0223269b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85538) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af71f5-bbba-474c-b147-635b197ec1ee]: (4, ('', '')) {{(pid=85538) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75051) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.base [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] <== disconnect_volume: return (261ms) None {{(pid=75051) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Disconnected iSCSI Volume {{(pid=75051) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 24 19:59:44 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:45 user nova-compute[75051]: DEBUG nova.objects.instance [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'flavor' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 19:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-2e180eba-61b9-4ddc-bd09-9d86a02f8f73 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.711s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.114s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 19:59:45 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:49 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:53 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Cleaning up deleted instances {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 24 19:59:53 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] There are 0 instances to clean {{(pid=75051) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 24 19:59:54 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:58 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 19:59:58 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 19:59:59 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 20:00:04 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.processutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75051) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 24 20:00:05 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:00:05 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.10555648803711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Instance d189f93a-b404-47ed-93f8-dac9f48fe6eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75051) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing inventories for resource provider f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating ProviderTree inventory for provider f8429778-9501-4346-bab2-835efc6150b7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Updating inventory in ProviderTree for provider f8429778-9501-4346-bab2-835efc6150b7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 24 20:00:05 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing aggregate associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, aggregates: None {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 24 20:00:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Refreshing trait associations for resource provider f8429778-9501-4346-bab2-835efc6150b7, traits: COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW {{(pid=75051) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 24 20:00:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 20:00:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 20:00:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 20:00:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:09 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquired lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Forcefully refreshing network info cache for instance {{(pid=75051) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 24 20:00:10 user nova-compute[75051]: DEBUG nova.objects.instance [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lazy-loading 'info_cache' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 20:00:11 user nova-compute[75051]: DEBUG nova.network.neutron [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [{"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 20:00:11 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Releasing lock "refresh_cache-d189f93a-b404-47ed-93f8-dac9f48fe6eb" {{(pid=75051) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 24 20:00:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updated the network info_cache for instance {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 24 20:00:14 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:00:19 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:00:24 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:29 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:34 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:37 user nova-compute[75051]: INFO nova.compute.manager [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Terminating instance
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Start destroying the instance on the hypervisor. {{(pid=75051) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-unplugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] No waiting events found dispatching network-vif-unplugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [req-ee385bff-197e-45d6-ad9e-004fbefeb615 req-6d36c680-1bbb-4fda-a4cb-e2bc3797d8db service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-unplugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa for instance with task_state deleting. {{(pid=75051) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Instance destroyed successfully.
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.objects.instance [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lazy-loading 'resources' on Instance uuid d189f93a-b404-47ed-93f8-dac9f48fe6eb {{(pid=75051) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.virt.libvirt.vif [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-24T19:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1728409686',display_name='tempest-SnapshotDataIntegrityTests-server-1728409686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1728409686',id=53,image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFdYFxXWy3PajPlYu5iDJPgef+Q5295aV+F+bYkaWfqDuVgX9V6e83aPHIeg3yKpF4jMqMbwMj689KRYdMkHxb83doKCOAkqxhi93eoSC1pdXQWdTzpQEOsYQnDe1PH7Q==',key_name='tempest-keypair-1465345427',keypairs=<?>,launch_index=0,launched_at=2023-11-24T19:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3872d888c26438d975a06808def6cb1',ramdisk_id='',reservation_id='r-efi5s3ze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5493a48f-5fd1-4417-ad27-dfb869ec17c2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1591823232',owner_user_name='tempest-SnapshotDataIntegrityTests-1591823232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-24T19:54:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2aec05ddef524b0ea53b5d949cfccecb',uuid=d189f93a-b404-47ed-93f8-dac9f48fe6eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converting VIF {"id": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "address": "fa:16:3e:61:7e:c0", "network": {"id": "8b67d28d-240e-438f-8669-e7ec25b70007", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-433368600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3872d888c26438d975a06808def6cb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6927600b-80", "ovs_interfaceid": "6927600b-8090-4bd3-b4b0-9e7467d8ddfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.network.os_vif_util [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80') {{(pid=75051) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG os_vif [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80') {{(pid=75051) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6927600b-80, bridge=br-int, if_exists=True) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87ef842a-3f54-4441-851d-618dc6479e18) {{(pid=75051) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:00:37 user nova-compute[75051]: INFO os_vif [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:7e:c0,bridge_name='br-int',has_traffic_filtering=True,id=6927600b-8090-4bd3-b4b0-9e7467d8ddfa,network=Network(8b67d28d-240e-438f-8669-e7ec25b70007),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6927600b-80')
Nov 24 20:00:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Deleting instance files /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb_del
Nov 24 20:00:37 user nova-compute[75051]: INFO nova.virt.libvirt.driver [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Deletion of /opt/stack/data/nova/instances/d189f93a-b404-47ed-93f8-dac9f48fe6eb_del complete
Nov 24 20:00:37 user nova-compute[75051]: INFO nova.compute.manager [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 24 20:00:37 user nova-compute[75051]: DEBUG oslo.service.loopingcall [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75051) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.compute.manager [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Deallocating network for instance {{(pid=75051) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 24 20:00:37 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] deallocate_for_instance() {{(pid=75051) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 24 20:00:38 user nova-compute[75051]: DEBUG nova.network.neutron [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Updating instance_info_cache with network_info: [] {{(pid=75051) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 24 20:00:38 user nova-compute[75051]: INFO nova.compute.manager [-] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Took 0.75 seconds to deallocate network for instance.
Nov 24 20:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:38 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 20:00:38 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 20:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:38 user nova-compute[75051]: INFO nova.scheduler.client.report [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Deleted allocations for instance d189f93a-b404-47ed-93f8-dac9f48fe6eb
Nov 24 20:00:38 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-6b96369c-6881-4f10-a0f2-67511102f5a8 tempest-SnapshotDataIntegrityTests-1591823232 tempest-SnapshotDataIntegrityTests-1591823232-project-member] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.940s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 20:00:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] Acquiring lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:00:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:00:39 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] Lock "d189f93a-b404-47ed-93f8-dac9f48fe6eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:00:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] No waiting events found dispatching network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 24 20:00:39 user nova-compute[75051]: WARNING nova.compute.manager [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received unexpected event network-vif-plugged-6927600b-8090-4bd3-b4b0-9e7467d8ddfa for instance with vm_state deleted and task_state None.
Nov 24 20:00:39 user nova-compute[75051]: DEBUG nova.compute.manager [req-1db559e3-ec78-416d-84a3-81380f01cc9f req-c4c4b721-6f4e-44f9-bc5b-787f9b8d9e93 service nova] [instance: d189f93a-b404-47ed-93f8-dac9f48fe6eb] Received event network-vif-deleted-6927600b-8090-4bd3-b4b0-9e7467d8ddfa {{(pid=75051) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 24 20:00:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:00:57 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:00 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:00 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 20:01:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:01:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:01:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:01:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:01:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 20:01:06 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:01:06 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.124835968017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 20:01:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:01:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:10 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 20:01:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 20:01:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 20:01:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:15 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:16 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:21 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:01:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:01:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:30 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:33 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:01:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 20:02:05 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:02:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:02:05 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:02:05 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75051) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 24 20:02:06 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:02:06 user nova-compute[75051]: WARNING nova.virt.libvirt.driver [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=25.116600036621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75051) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75051) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.compute.provider_tree [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed in ProviderTree for provider: f8429778-9501-4346-bab2-835efc6150b7 {{(pid=75051) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.scheduler.client.report [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Inventory has not changed for provider f8429778-9501-4346-bab2-835efc6150b7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75051) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG nova.compute.resource_tracker [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Compute_service record updated for user:user {{(pid=75051) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 24 20:02:06 user nova-compute[75051]: DEBUG oslo_concurrency.lockutils [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75051) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 24 20:02:07 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:11 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Starting heal instance info cache {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 24 20:02:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Rebuilding the list of instances to heal {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 24 20:02:11 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Didn't find any instances for network info cache update. {{(pid=75051) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 24 20:02:12 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:17 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:17 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:18 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:20 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:22 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:22 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:02:27 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:32 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:02:37 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:42 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:02:47 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:52 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:57 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:02:59 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG oslo_service.periodic_task [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75051) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG nova.compute.manager [None req-9377a3ba-94ea-49e1-a245-e2d01a7ac8b2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75051) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75051) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75051) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 24 20:03:02 user nova-compute[75051]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75051) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}